Apr 29 17:04:12 devstack cinder-volume[75845]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 17:04:12 devstack cinder-volume[75845]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 17:04:12 devstack cinder-volume[75845]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 17:04:13 devstack cinder-volume[75845]: INFO dbcounter [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Registered counter for database cinder Apr 29 17:04:13 devstack cinder-volume[75845]: DEBUG oslo_db.sqlalchemy.engines [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75845) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 17:04:13 devstack cinder-volume[75845]: DEBUG dbcounter [-] [75845] Writer thread running {{(pid=75845) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 17:04:13 devstack cinder-volume[75845]: INFO cinder.rpc [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 17:04:13 devstack cinder-volume[75845]: INFO cinder.rpc [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 17:04:13 devstack cinder-volume[75845]: DEBUG oslo_db.sqlalchemy.engines [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75845) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 17:04:13 devstack cinder-volume[75845]: INFO cinder.volume.manager [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Determined volume DB was empty at startup. Apr 29 17:04:13 devstack cinder-volume[75845]: DEBUG cinder.volume.manager [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75845) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 17:04:13 devstack cinder-volume[75845]: INFO cinder.volume.manager [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 17:04:13 devstack cinder-volume[75845]: WARNING stevedore.named [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 17:04:13 devstack cinder-volume[75845]: WARNING castellan.key_manager [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 17:04:13 devstack cinder-volume[75845]: WARNING cinder.keymgr.conf_key_mgr [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 17:04:13 devstack cinder-volume[75845]: DEBUG cinder.volume.drivers.lvm [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75845) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 29 17:04:13 devstack cinder-volume[75845]: DEBUG oslo_concurrency.processutils [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75845) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:13 devstack cinder-volume[75845]: DEBUG oslo_concurrency.processutils [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] CMD "cinder-rtstool verify" returned: 0 in 0.391s {{(pid=75845) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_db.sqlalchemy.engines [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75845) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 17:04:14 devstack cinder-volume[75845]: INFO cinder.rpc [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 29 17:04:14 devstack cinder-volume[75845]: INFO cinder.rpc [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 29 17:04:14 devstack cinder-volume[75845]: WARNING stevedore.named [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 17:04:14 devstack cinder-volume[75845]: WARNING castellan.key_manager [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 17:04:14 devstack cinder-volume[75845]: INFO cinder.volume.manager [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_db.sqlalchemy.engines [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75845) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 17:04:14 devstack cinder-volume[75845]: INFO oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Starting 1 workers Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Started child 76018 {{(pid=75845) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Full set of CONF: {{(pid=75845) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] ******************************************************************************** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Configuration options gathered from: {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] ================================================================================ {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] allow_availability_zone_fallback = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] allow_compression_on_image_upload = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[76018]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] allowed_direct_url_schemes = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] api_rate_limit = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] auth_strategy = keystone {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] az_cache_duration = 3600 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_availability_zone = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_host = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_stats_polling_interval = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backup_api_class = cinder.backup.api.API {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backup_name_template = backup-%s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backup_use_same_host = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backup_use_temp_snapshot = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] chap_password = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] chap_username = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cinder_internal_tenant_project_id = 771b3bf0fd794a929c2d1c13a445f137 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cinder_internal_tenant_user_id = 80355330dc574723826cb3f79a637bd0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cloned_volume_same_az = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cluster = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] compression_format = gzip {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] compute_api_class = cinder.compute.nova.API {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] config_dir = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] config_source = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] control_exchange = openstack {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] debug = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] default_availability_zone = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] default_group_type = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] default_volume_type = lvmdriver-1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] disk_geometry = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] driver_client_cert = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] driver_client_cert_key = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] driver_data_namespace = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] driver_ssl_cert_path = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] driver_ssl_cert_verify = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] driver_use_ssl = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] enable_force_upload = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] enable_new_services = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] enable_unsupported_driver = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack sudo[76026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] enabled_backends = ['lvmdriver-1'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] enforce_multipath_for_image_xfer = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] filter_function = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] glance_api_insecure = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] glance_api_servers = ['http://192.168.122.196/image'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] glance_api_ssl_compression = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack sudo[76026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] glance_ca_certificates_file = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] glance_catalog_info = image:glance:publicURL {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] glance_certfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] glance_keyfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] glance_num_retries = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] glance_request_timeout = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] goodness_function = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] graceful_shutdown_timeout = 5 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] group_api_class = cinder.group.api.API {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] host = devstack {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] image_compress_on_upload = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] image_conversion_address_space_limit = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] image_conversion_cpu_limit = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] image_conversion_disable = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] image_upload_use_cinder_backend = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] image_upload_use_internal_tenant = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] image_volume_cache_enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] image_volume_cache_max_count = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] image_volume_cache_max_size_gb = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[76018]: INFO cinder.volume.manager [None req-8e3885df-663a-4697-9640-2778e29550df None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 29 17:04:14 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] init_host_max_objects_retrieval = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] instance_format = [instance: %(uuid)s] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] iscsi_target_flags = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] iscsi_write_cache = on {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] iser_helper = tgtadm {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] iser_ip_address = 192.168.122.196 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] iser_port = 3260 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] log_color = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] log_config_append = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] log_dir = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] log_file = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] log_options = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] log_rotate_interval = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] log_rotate_interval_type = days {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] log_rotation_type = none {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] max_age = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] max_logfile_count = 30 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] max_logfile_size_mb = 200 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] max_over_subscription_ratio = 20.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] message_reap_interval = 86400 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] message_ttl = 2592000 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] migration_create_volume_timeout_secs = 300 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] monkey_patch = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] monkey_patch_modules = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] my_ip = 192.168.122.196 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] no_snapshot_gb_quota = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] num_iser_scan_tries = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] num_shell_tries = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] num_volume_device_scan_tries = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] nvmeof_conn_info_version = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] nvmet_ns_id = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] nvmet_port_id = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] osapi_max_limit = 1000 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] osapi_volume_ext_list = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] osapi_volume_listen = 0.0.0.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] osapi_volume_listen_port = 8776 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] osapi_volume_use_ssl = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] osapi_volume_workers = 2 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] per_volume_size_limit = -1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] periodic_fuzzy_delay = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] periodic_interval = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] project_id_regex = [0-9a-f\-]+ {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] public_endpoint = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] publish_errors = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] quota_backup_gigabytes = 1000 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] quota_backups = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] quota_gigabytes = 1000 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] quota_groups = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] quota_snapshots = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] quota_volumes = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] rate_limit_burst = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] rate_limit_except_level = CRITICAL {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] rate_limit_interval = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] reinit_driver_count = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] replication_device = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] report_discard_supported = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] report_interval = 120 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] reservation_clean_interval = 86400 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] reservation_expire = 86400 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] reserved_image_namespaces = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] reserved_percentage = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] rpc_response_timeout = 120 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] run_external_periodic_tasks = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] scst_target_driver = iscsi {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] scst_target_iqn_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] service_down_time = 720 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] shell_completion = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] snapshot_name_template = snapshot-%s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] snapshot_same_host = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] split_loggers = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] state_path = /opt/stack/data/cinder {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] storage_availability_zone = nova {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] storage_protocol = iSCSI {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] syslog_log_facility = LOG_USER {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] target_helper = lioadm {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] target_ip_address = 192.168.122.196 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] target_port = 3260 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] target_protocol = iscsi {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] target_secondary_ip_addresses = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] trace_flags = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] transfer_api_class = cinder.transfer.api.API {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] transport_url = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] until_refresh = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] use_chap_auth = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] use_default_quota_class = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] use_journal = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] use_json = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] use_multipath_for_image_xfer = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] use_stderr = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] use_syslog = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] verify_glance_signatures = enabled {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] volume_api_class = cinder.volume.api.API {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] volume_backend_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] volume_clear = zero {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] volume_clear_ionice = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] volume_clear_size = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] volume_copy_bps_limit = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] volume_dd_blocksize = 1M {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] volume_name_template = volume-%s {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] volume_service_inithost_offload = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] volume_usage_audit_period = month {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] zoning_mode = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_concurrency.disable_process_locking = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.admin_password = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.admin_token = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.admin_user = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.auth_admin_prefix = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.auth_port = 35357 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.auth_protocol = https {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.auth_section = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.auth_type = password {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.auth_uri = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.auth_version = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.cache = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.certfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.delay_auth_decision = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.http_connect_timeout = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.identity_uri = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.include_service_catalog = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.insecure = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.interface = public {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.keyfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.memcache_password = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.memcache_username = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.region_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.service_token_roles_required = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.service_type = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.token_cache_time = 300 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.196/identity {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.backend = dogpile.cache.null {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.backend_argument = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.backend_expiration_time = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.config_prefix = cache.oslo {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.debug_cache_backend = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.enable_retry_client = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.enable_socket_keepalive = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.enforce_fips_mode = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.expiration_time = 600 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.hashclient_retry_attempts = 2 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.memcache_dead_retry = 300 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.memcache_pool_maxsize = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.memcache_sasl_enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.password = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.proxies = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.redis_db = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.redis_sentinel_service_name = mymaster {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.redis_server = localhost:6379 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.retry_attempts = 2 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.retry_delay = 0.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.socket_keepalive_count = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.socket_keepalive_idle = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.socket_keepalive_interval = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.socket_timeout = 1.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.tls_allowed_ciphers = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.tls_cafile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.tls_certfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.tls_enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.tls_keyfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cache.username = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] coordination.backend_url = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.asyncio_connection = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.asyncio_slave_connection = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.backend = sqlalchemy {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.connection = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:14 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.connection_debug = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.connection_parameters = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.connection_recycle_time = 3600 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.connection_trace = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.db_inc_retry_interval = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.db_max_retries = 20 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.db_max_retry_interval = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.db_retry_interval = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.max_overflow = 50 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.max_pool_size = 5 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.max_retries = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.mysql_wsrep_sync_wait = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.pool_timeout = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.retry_interval = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.slave_connection = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.sqlite_synchronous = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.synchronous_reader = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] database.use_db_reconnect = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] profiler.connection_string = messaging:// {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] profiler.enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] profiler.es_doc_type = notification {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] profiler.es_scroll_size = 10000 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] profiler.es_scroll_time = 2m {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] profiler.filter_error_trace = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] profiler.hmac_keys = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] profiler.sentinel_service_name = mymaster {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] profiler.socket_timeout = 0.1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] profiler.trace_requests = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] profiler.trace_sqlalchemy = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] profiler_jaeger.process_tags = {} {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] profiler_jaeger.service_name_prefix = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] profiler_otlp.service_name_prefix = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_policy.enforce_new_defaults = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: WARNING oslo_config.cfg [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_policy.enforce_scope = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_policy.policy_default_rule = default {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_policy.policy_file = policy.yaml {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_policy.remote_timeout = 60.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] privsep_osbrick.group = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] privsep_osbrick.helper_command = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] privsep_osbrick.user = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cinder_sys_admin.group = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cinder_sys_admin.helper_command = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack sudo[76026]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] cinder_sys_admin.user = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] service_user.auth_section = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] service_user.auth_type = password {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] service_user.cafile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] service_user.certfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] service_user.collect_timing = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] service_user.insecure = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] service_user.keyfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] service_user.send_service_user_token = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] service_user.split_loggers = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] service_user.timeout = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] glance.auth_section = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] glance.auth_type = password {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] glance.certfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] glance.collect_timing = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] glance.insecure = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] glance.keyfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] glance.region_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] glance.split_loggers = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] glance.timeout = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.backend_availability_zone = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.chap_password = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.chap_username = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.disk_geometry = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.driver_client_cert = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.driver_client_cert_key = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.driver_data_namespace = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.driver_use_ssl = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.enable_unsupported_driver = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack sudo[76222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.extra_capabilities = {} {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.filter_function = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.goodness_function = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.iscsi_target_flags = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.iscsi_write_cache = on {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.iser_helper = tgtadm {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.iser_ip_address = 192.168.122.196 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack sudo[76222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.iser_port = 3260 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.lvm_mirrors = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.lvm_share_target = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.lvm_type = auto {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.num_shell_tries = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.nvmet_port_id = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.replication_device = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.report_discard_supported = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.reserved_percentage = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.scst_target_driver = iscsi {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.scst_target_iqn_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.storage_protocol = iSCSI {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.target_helper = tgtadm {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.target_ip_address = 192.168.122.196 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.target_port = 3260 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.target_protocol = iscsi {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.trace_flags = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.unique_fqdn_network = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.use_chap_auth = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.volume_backend_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.volume_clear = zero {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.volume_clear_ionice = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.volume_clear_size = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.volume_group = cinder-volumes {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_reports.file_event_handler = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_reports.log_dir = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.backend_availability_zone = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.backend_host = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.chap_password = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.chap_username = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.chiscsi_conf = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.disk_geometry = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.driver_client_cert = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.driver_data_namespace = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.driver_use_ssl = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.extra_capabilities = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.filter_function = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.goodness_function = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.iser_helper = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.iser_ip_address = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.iser_port = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.iser_target_prefix = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.lvm_conf_file = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.lvm_mirrors = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.lvm_share_target = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.lvm_type = auto {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.num_shell_tries = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.nvmet_port_id = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.replication_device = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.report_discard_supported = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.reserved_percentage = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.scst_target_driver = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.storage_protocol = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.target_helper = lioadm {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.target_ip_address = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.target_port = 3260 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.target_protocol = iscsi {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.trace_flags = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.use_chap_auth = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.volume_clear = zero {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.volume_clear_size = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] lvmdriver-1.volumes_dir = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.ssl = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.ssl_version = {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_notifications.driver = [] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_notifications.retry = -1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] oslo_messaging_notifications.transport_url = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] key_manager.fixed_key = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican.barbican_api_version = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican.barbican_endpoint = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican.barbican_endpoint_type = public {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican.barbican_region_name = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican.cafile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican.certfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican.collect_timing = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican.insecure = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican.keyfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican.number_of_retries = 60 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican.retry_delay = 1 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican.send_service_user_token = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican.split_loggers = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican.timeout = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican.verify_ssl = True {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican.verify_ssl_path = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican_service_user.auth_section = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican_service_user.auth_type = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican_service_user.cafile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican_service_user.certfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican_service_user.collect_timing = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican_service_user.insecure = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican_service_user.keyfile = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican_service_user.split_loggers = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] barbican_service_user.timeout = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] vault.approle_role_id = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] vault.approle_secret_id = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] vault.kv_mountpoint = secret {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] vault.kv_path = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] vault.kv_version = 2 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] vault.namespace = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] vault.root_token_id = **** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] vault.ssl_ca_crt_file = None {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] vault.timeout = 60.0 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] vault.use_ssl = False {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:04:15 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] ******************************************************************************** {{(pid=75845) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 17:04:15 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.788s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:15 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:15 devstack sudo[76222]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:15 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.623s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:15 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:04:15 devstack cinder-volume[76018]: INFO cinder.brick.local_dev.lvm [None req-8e3885df-663a-4697-9640-2778e29550df None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 29 17:04:15 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:15 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:15 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:15 devstack sudo[76443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 17:04:15 devstack sudo[76443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:16 devstack sudo[76443]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:16 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:16 devstack cinder-volume[76018]: DEBUG cinder.brick.local_dev.lvm [None req-8e3885df-663a-4697-9640-2778e29550df None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76018) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 29 17:04:16 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:16 devstack sudo[76586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 17:04:16 devstack sudo[76586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:17 devstack sudo[76586]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:17 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.948s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:17 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:17 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:17 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:17 devstack sudo[76735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 17:04:17 devstack sudo[76735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:18 devstack sudo[76735]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:18 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.707s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:18 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:18 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:18 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:18 devstack sudo[76796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 29 17:04:18 devstack sudo[76796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:18 devstack sudo[76796]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:18 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.728s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:18 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:18 devstack sudo[76805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 17:04:18 devstack sudo[76805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:19 devstack sudo[76805]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:19 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.724s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:19 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:19 devstack sudo[76810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 17:04:19 devstack sudo[76810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:20 devstack sudo[76810]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:20 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:20 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:20 devstack sudo[76814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 17:04:20 devstack sudo[76814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:20 devstack sudo[76814]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:20 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:20 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:20 devstack sudo[76818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 17:04:20 devstack sudo[76818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:21 devstack sudo[76818]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:21 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.601s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:21 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:21 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:21 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:21 devstack sudo[76823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 17:04:21 devstack sudo[76823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:22 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.774s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:22 devstack sudo[76823]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:22 devstack cinder-volume[76018]: INFO cinder.volume.drivers.lvm [None req-8e3885df-663a-4697-9640-2778e29550df None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 29 17:04:22 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:22 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:22 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:22 devstack sudo[76830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 17:04:22 devstack sudo[76830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:23 devstack sudo[76830]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:23 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.799s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:23 devstack cinder-volume[76018]: DEBUG cinder.volume.drivers.lvm [None req-8e3885df-663a-4697-9640-2778e29550df None None] Updating volume stats {{(pid=76018) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 17:04:23 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:23 devstack sudo[76941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 17:04:23 devstack sudo[76941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:23 devstack sudo[76941]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:23 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:23 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:23 devstack sudo[76956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 17:04:23 devstack sudo[76956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:24 devstack cinder-volume[75845]: DEBUG dbcounter [-] [75845] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75845) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:04:24 devstack sudo[76956]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:24 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:24 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:24 devstack sudo[77096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 17:04:24 devstack sudo[77096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:25 devstack sudo[77096]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:25 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.662s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:25 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:25 devstack sudo[77103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 17:04:25 devstack sudo[77103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:25 devstack sudo[77103]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:25 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.604s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:25 devstack cinder-volume[76018]: INFO cinder.volume.driver [None req-8e3885df-663a-4697-9640-2778e29550df None None] Driver hasn't implemented _init_vendor_properties() Apr 29 17:04:25 devstack cinder-volume[76018]: DEBUG cinder.volume.driver [None req-8e3885df-663a-4697-9640-2778e29550df None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76018) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 17:04:25 devstack cinder-volume[76018]: DEBUG oslo_db.sqlalchemy.engines [None req-8e3885df-663a-4697-9640-2778e29550df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76018) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 17:04:25 devstack cinder-volume[76018]: DEBUG dbcounter [-] [76018] Writer thread running {{(pid=76018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 17:04:25 devstack cinder-volume[76018]: DEBUG cinder.db.sqlalchemy.api [None req-8e3885df-663a-4697-9640-2778e29550df None None] Building query based on filter {{(pid=76018) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 17:04:25 devstack cinder-volume[76018]: DEBUG cinder.image.image_utils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76018) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 17:04:25 devstack cinder-volume[76018]: INFO cinder.keymgr.migration [None req-1e23c529-6c4b-4ec5-975d-ff5a3e2a7478 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 17:04:25 devstack cinder-volume[76018]: DEBUG cinder.volume.drivers.lvm [None req-8e3885df-663a-4697-9640-2778e29550df None None] Updating volume stats {{(pid=76018) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 17:04:25 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:25 devstack sudo[77107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 17:04:25 devstack sudo[77107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:26 devstack sudo[77107]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:26 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.592s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:26 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:26 devstack sudo[77110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 17:04:26 devstack sudo[77110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:26 devstack sudo[77110]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:26 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.587s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:26 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:26 devstack sudo[77113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 17:04:26 devstack sudo[77113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:27 devstack sudo[77113]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:27 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.601s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:27 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:27 devstack sudo[77117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 17:04:27 devstack sudo[77117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:28 devstack sudo[77117]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:28 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.595s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:28 devstack cinder-volume[76018]: DEBUG cinder.manager [None req-8e3885df-663a-4697-9640-2778e29550df None None] Notifying Schedulers of capabilities ... {{(pid=76018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:04:28 devstack cinder-volume[76018]: INFO cinder.volume.manager [None req-8e3885df-663a-4697-9640-2778e29550df None None] Driver initialization completed successfully. Apr 29 17:04:28 devstack cinder-volume[76018]: INFO cinder.manager [None req-8e3885df-663a-4697-9640-2778e29550df None None] Initiating service 2 cleanup Apr 29 17:04:28 devstack cinder-volume[76018]: INFO cinder.manager [None req-8e3885df-663a-4697-9640-2778e29550df None None] Service 2 cleanup completed. Apr 29 17:04:28 devstack cinder-volume[76018]: DEBUG cinder.service [None req-8e3885df-663a-4697-9640-2778e29550df None None] Creating RPC server for service cinder-volume {{(pid=76018) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 17:04:28 devstack cinder-volume[76018]: DEBUG cinder.service [None req-8e3885df-663a-4697-9640-2778e29550df None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76018) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 17:04:28 devstack cinder-volume[76018]: INFO cinder.volume.manager [None req-8e3885df-663a-4697-9640-2778e29550df None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 29 17:04:28 devstack cinder-volume[76018]: DEBUG cinder.volume.drivers.lvm [None req-8e3885df-663a-4697-9640-2778e29550df None None] Updating volume stats {{(pid=76018) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 17:04:28 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:28 devstack sudo[77124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 17:04:28 devstack sudo[77124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:28 devstack sudo[77124]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:28 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.610s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:28 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:29 devstack sudo[77128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 17:04:29 devstack sudo[77128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:29 devstack sudo[77128]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:29 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:29 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:29 devstack sudo[77131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 17:04:29 devstack sudo[77131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:30 devstack sudo[77131]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:30 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.602s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:30 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:04:30 devstack sudo[77188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 17:04:30 devstack sudo[77188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:04:30 devstack sudo[77188]: pam_unix(sudo:session): session closed for user root Apr 29 17:04:30 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-8e3885df-663a-4697-9640-2778e29550df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.591s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:04:30 devstack cinder-volume[76018]: INFO cinder.volume.manager [None req-8e3885df-663a-4697-9640-2778e29550df None None] Driver post RPC initialization completed successfully. Apr 29 17:04:38 devstack cinder-volume[76018]: DEBUG dbcounter [-] [76018] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:04:40 devstack cinder-volume[76018]: DEBUG dbcounter [-] [76018] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=76018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:05:49 devstack cinder-volume[76018]: DEBUG oslo_service.periodic_task [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:05:49 devstack cinder-volume[76018]: DEBUG cinder.volume.drivers.lvm [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] Updating volume stats {{(pid=76018) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 17:05:49 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:05:49 devstack sudo[81880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 17:05:49 devstack sudo[81880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:05:50 devstack sudo[81880]: pam_unix(sudo:session): session closed for user root Apr 29 17:05:50 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.586s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:05:50 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:05:50 devstack sudo[81883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 17:05:50 devstack sudo[81883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:05:51 devstack sudo[81883]: pam_unix(sudo:session): session closed for user root Apr 29 17:05:51 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.606s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:05:51 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:05:51 devstack sudo[81902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 17:05:51 devstack sudo[81902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:05:51 devstack sudo[81902]: pam_unix(sudo:session): session closed for user root Apr 29 17:05:51 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.604s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:05:51 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:05:51 devstack sudo[81905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 17:05:51 devstack sudo[81905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:05:52 devstack sudo[81905]: pam_unix(sudo:session): session closed for user root Apr 29 17:05:52 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:05:52 devstack cinder-volume[76018]: DEBUG cinder.manager [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] Notifying Schedulers of capabilities ... {{(pid=76018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:06:40 devstack cinder-volume[76018]: DEBUG dbcounter [-] [76018] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76018) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:06:49 devstack cinder-volume[76018]: DEBUG oslo_service.periodic_task [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76018) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:06:49 devstack cinder-volume[76018]: DEBUG cinder.volume.drivers.lvm [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] Updating volume stats {{(pid=76018) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 17:06:49 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:06:49 devstack sudo[82314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 17:06:49 devstack sudo[82314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:06:50 devstack sudo[82314]: pam_unix(sudo:session): session closed for user root Apr 29 17:06:50 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.582s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:06:50 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:06:50 devstack sudo[82334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 17:06:50 devstack sudo[82334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:06:51 devstack sudo[82334]: pam_unix(sudo:session): session closed for user root Apr 29 17:06:51 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.598s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:06:51 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:06:51 devstack sudo[82353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 17:06:51 devstack sudo[82353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:06:51 devstack sudo[82353]: pam_unix(sudo:session): session closed for user root Apr 29 17:06:51 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.593s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:06:51 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:06:51 devstack sudo[82356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 17:06:51 devstack sudo[82356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:06:52 devstack sudo[82356]: pam_unix(sudo:session): session closed for user root Apr 29 17:06:52 devstack cinder-volume[76018]: DEBUG oslo_concurrency.processutils [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=76018) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:06:52 devstack cinder-volume[76018]: DEBUG cinder.manager [None req-12d4fd83-ee21-46d0-bbf8-1c752b381b34 None None] Notifying Schedulers of capabilities ... {{(pid=76018) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:07:16 devstack cinder-volume[75845]: INFO oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Caught SIGTERM, stopping children Apr 29 17:07:16 devstack cinder-volume[75845]: DEBUG oslo_concurrency.lockutils [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Acquiring lock "singleton_lock" {{(pid=75845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 17:07:16 devstack cinder-volume[75845]: DEBUG oslo_concurrency.lockutils [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Acquired lock "singleton_lock" {{(pid=75845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 17:07:16 devstack cinder-volume[75845]: DEBUG oslo_concurrency.lockutils [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Releasing lock "singleton_lock" {{(pid=75845) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 17:07:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Stop services. {{(pid=75845) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 17:07:16 devstack cinder-volume[75845]: DEBUG oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Killing children. {{(pid=75845) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 17:07:16 devstack cinder-volume[75845]: INFO oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Waiting on 1 children to exit Apr 29 17:07:18 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Acquiring lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 17:07:18 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Acquired lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 17:07:18 devstack cinder-volume[76018]: DEBUG oslo_concurrency.lockutils [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Releasing lock "singleton_lock" {{(pid=76018) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 17:07:18 devstack cinder-volume[76018]: WARNING amqp [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 17:07:18 devstack cinder-volume[76018]: WARNING amqp [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 17:07:18 devstack cinder-volume[75845]: INFO oslo_service.backend._eventlet.service [None req-d502d17a-17ca-4d7a-aaee-1896ebd4097f None None] Child 76018 exited with status 0 Apr 29 17:07:20 devstack cinder-volume[83658]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83658) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 17:07:20 devstack cinder-volume[83658]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83658) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 17:07:20 devstack cinder-volume[83658]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83658) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 17:07:21 devstack cinder-volume[83658]: INFO dbcounter [None req-955969d0-4670-416a-a256-aac103625564 None None] Registered counter for database cinder Apr 29 17:07:21 devstack cinder-volume[83658]: DEBUG oslo_db.sqlalchemy.engines [None req-955969d0-4670-416a-a256-aac103625564 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83658) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG dbcounter [-] [83658] Writer thread running {{(pid=83658) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 17:07:22 devstack cinder-volume[83658]: INFO cinder.rpc [None req-955969d0-4670-416a-a256-aac103625564 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 17:07:22 devstack cinder-volume[83658]: INFO cinder.rpc [None req-955969d0-4670-416a-a256-aac103625564 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_db.sqlalchemy.engines [None req-955969d0-4670-416a-a256-aac103625564 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83658) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 17:07:22 devstack cinder-volume[83658]: INFO cinder.volume.manager [None req-955969d0-4670-416a-a256-aac103625564 None None] Determined volume DB was empty at startup. Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG cinder.volume.manager [None req-955969d0-4670-416a-a256-aac103625564 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83658) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 17:07:22 devstack cinder-volume[83658]: INFO cinder.volume.manager [None req-955969d0-4670-416a-a256-aac103625564 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 17:07:22 devstack cinder-volume[83658]: WARNING stevedore.named [None req-955969d0-4670-416a-a256-aac103625564 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 17:07:22 devstack cinder-volume[83658]: WARNING castellan.key_manager [None req-955969d0-4670-416a-a256-aac103625564 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 17:07:22 devstack cinder-volume[83658]: WARNING cinder.keymgr.conf_key_mgr [None req-955969d0-4670-416a-a256-aac103625564 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 17:07:22 devstack cinder-volume[83658]: INFO cinder.volume.manager [None req-955969d0-4670-416a-a256-aac103625564 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_db.sqlalchemy.engines [None req-955969d0-4670-416a-a256-aac103625564 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83658) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 17:07:22 devstack cinder-volume[83658]: INFO oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] Starting 1 workers Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] Started child 83941 {{(pid=83658) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] Full set of CONF: {{(pid=83658) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] ******************************************************************************** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] Configuration options gathered from: {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] ================================================================================ {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] allow_availability_zone_fallback = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83941]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] allow_compression_on_image_upload = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] allowed_direct_url_schemes = [] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] api_rate_limit = True {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] auth_strategy = keystone {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_availability_zone = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_host = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_name = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_stats_polling_interval = 60 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backup_api_class = cinder.backup.api.API {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backup_name_template = backup-%s {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backup_use_same_host = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backup_use_temp_snapshot = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] chap_password = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] chap_username = {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cinder_internal_tenant_project_id = 771b3bf0fd794a929c2d1c13a445f137 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cinder_internal_tenant_user_id = 80355330dc574723826cb3f79a637bd0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cluster = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] compression_format = gzip {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] compute_api_class = cinder.compute.nova.API {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] config_dir = [] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] config_source = [] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] control_exchange = openstack {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] debug = True {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] default_availability_zone = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] default_group_type = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] default_volume_type = QuobyteHD {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] disk_geometry = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] driver_client_cert = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] driver_client_cert_key = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] driver_data_namespace = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] driver_ssl_cert_path = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] driver_ssl_cert_verify = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] driver_use_ssl = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] enable_new_services = True {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] enable_unsupported_driver = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] enabled_backends = ['QuobyteHD'] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] enforce_multipath_for_image_xfer = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] filter_function = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] glance_api_insecure = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] glance_api_servers = ['http://192.168.122.196/image'] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] glance_api_ssl_compression = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] glance_ca_certificates_file = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] glance_catalog_info = image:glance:publicURL {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] glance_certfile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] glance_keyfile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] glance_num_retries = 3 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] glance_request_timeout = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] goodness_function = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] graceful_shutdown_timeout = 5 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] group_api_class = cinder.group.api.API {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] host = devstack {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] image_compress_on_upload = True {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] image_conversion_address_space_limit = 1 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] image_conversion_cpu_limit = 60 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] image_conversion_disable = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] image_upload_use_cinder_backend = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] image_upload_use_internal_tenant = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] image_volume_cache_enabled = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] image_volume_cache_max_count = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] image_volume_cache_max_size_gb = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] init_host_max_objects_retrieval = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] instance_format = [instance: %(uuid)s] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] iscsi_target_flags = {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] iscsi_write_cache = on {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] iser_helper = tgtadm {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] iser_ip_address = 192.168.122.196 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] iser_port = 3260 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] log_color = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] log_config_append = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] log_dir = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] log_file = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] log_options = True {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] log_rotate_interval = 1 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] log_rotate_interval_type = days {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] log_rotation_type = none {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] max_age = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] max_logfile_count = 30 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] max_logfile_size_mb = 200 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] max_over_subscription_ratio = 20.0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] message_reap_interval = 86400 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] message_ttl = 2592000 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] migration_create_volume_timeout_secs = 300 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] monkey_patch = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] monkey_patch_modules = [] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] my_ip = 192.168.122.196 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] no_snapshot_gb_quota = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] num_iser_scan_tries = 3 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] num_shell_tries = 3 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] num_volume_device_scan_tries = 3 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] nvmeof_conn_info_version = 1 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] nvmet_ns_id = 10 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] nvmet_port_id = 1 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] osapi_max_limit = 1000 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] osapi_volume_ext_list = [] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] osapi_volume_listen_port = 8776 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] osapi_volume_use_ssl = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] osapi_volume_workers = 2 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] per_volume_size_limit = -1 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] periodic_fuzzy_delay = 60 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] periodic_interval = 60 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] public_endpoint = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] publish_errors = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] quota_backup_gigabytes = 1000 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] quota_backups = 10 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] quota_gigabytes = 1000 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] quota_groups = 10 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] quota_snapshots = 10 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] quota_volumes = 10 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] rate_limit_burst = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] rate_limit_except_level = CRITICAL {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] rate_limit_interval = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] reinit_driver_count = 3 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] replication_device = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] report_discard_supported = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] report_interval = 120 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] reservation_clean_interval = 86400 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] reservation_expire = 86400 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] reserved_image_namespaces = [] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] reserved_percentage = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] rpc_response_timeout = 120 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] run_external_periodic_tasks = True {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] scst_target_driver = iscsi {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] scst_target_iqn_name = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] service_down_time = 720 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] shell_completion = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] snapshot_name_template = snapshot-%s {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] split_loggers = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] state_path = /opt/stack/data/cinder {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] storage_availability_zone = nova {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] storage_protocol = iSCSI {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] syslog_log_facility = LOG_USER {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] target_helper = lioadm {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] target_ip_address = 192.168.122.196 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] target_port = 3260 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] target_protocol = iscsi {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] target_secondary_ip_addresses = [] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] trace_flags = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] transport_url = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] until_refresh = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] use_chap_auth = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] use_default_quota_class = True {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] use_journal = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] use_json = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] use_multipath_for_image_xfer = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] use_stderr = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] use_syslog = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] verify_glance_signatures = enabled {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] volume_api_class = cinder.volume.api.API {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] volume_backend_name = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] volume_clear = zero {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] volume_clear_ionice = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] volume_clear_size = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] volume_copy_bps_limit = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] volume_dd_blocksize = 1M {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] volume_name_template = volume-%s {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] volume_service_inithost_offload = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] volume_usage_audit_period = month {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] zoning_mode = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_concurrency.disable_process_locking = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.admin_password = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.admin_token = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.admin_user = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.auth_port = 35357 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.auth_protocol = https {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.auth_section = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.auth_type = password {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.auth_uri = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.auth_version = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.cache = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.certfile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.identity_uri = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.include_service_catalog = True {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.insecure = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.interface = public {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.keyfile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.memcache_password = {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83941]: INFO cinder.volume.manager [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83941]: DEBUG cinder.volume.drivers.remotefs [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83941) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.memcache_username = {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.region_name = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.service_type = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.196/identity {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.backend = dogpile.cache.null {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.backend_argument = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.backend_expiration_time = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.config_prefix = cache.oslo {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.debug_cache_backend = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.enable_retry_client = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.enable_socket_keepalive = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.enabled = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.enforce_fips_mode = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.expiration_time = 600 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.hashclient_retry_attempts = 2 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.memcache_dead_retry = 300 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.memcache_pool_maxsize = 10 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.memcache_sasl_enabled = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.password = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.proxies = [] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.redis_db = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.redis_server = localhost:6379 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.retry_attempts = 2 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.retry_delay = 0.0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.socket_keepalive_count = 1 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.socket_keepalive_idle = 1 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.socket_keepalive_interval = 1 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.socket_timeout = 1.0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.tls_allowed_ciphers = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.tls_cafile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.tls_certfile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.tls_enabled = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.tls_keyfile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cache.username = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] coordination.backend_url = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.asyncio_connection = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.asyncio_slave_connection = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.backend = sqlalchemy {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.connection = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.connection_debug = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.connection_parameters = {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.connection_recycle_time = 3600 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.connection_trace = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.db_inc_retry_interval = True {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.db_max_retries = 20 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.db_max_retry_interval = 10 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.db_retry_interval = 1 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.max_overflow = 50 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.max_pool_size = 5 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.max_retries = 10 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.mysql_wsrep_sync_wait = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.pool_timeout = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.retry_interval = 10 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.slave_connection = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.sqlite_synchronous = True {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.synchronous_reader = True {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] database.use_db_reconnect = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] profiler.connection_string = messaging:// {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] profiler.enabled = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] profiler.es_doc_type = notification {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] profiler.es_scroll_size = 10000 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] profiler.es_scroll_time = 2m {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] profiler.filter_error_trace = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] profiler.hmac_keys = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] profiler.sentinel_service_name = mymaster {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] profiler.socket_timeout = 0.1 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] profiler.trace_requests = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] profiler.trace_sqlalchemy = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] profiler_jaeger.process_tags = {} {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] profiler_jaeger.service_name_prefix = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] profiler_otlp.service_name_prefix = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_policy.enforce_new_defaults = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: WARNING oslo_config.cfg [None req-955969d0-4670-416a-a256-aac103625564 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_policy.enforce_scope = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_policy.policy_default_rule = default {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_policy.policy_file = policy.yaml {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] privsep_osbrick.group = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] privsep_osbrick.helper_command = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] privsep_osbrick.user = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cinder_sys_admin.group = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cinder_sys_admin.helper_command = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] cinder_sys_admin.user = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] service_user.auth_section = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] service_user.auth_type = password {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] service_user.cafile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] service_user.certfile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] service_user.collect_timing = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] service_user.insecure = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] service_user.keyfile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] service_user.send_service_user_token = True {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] service_user.split_loggers = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] service_user.timeout = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] glance.auth_section = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] glance.auth_type = password {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] glance.certfile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] glance.collect_timing = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] glance.insecure = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] glance.keyfile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] glance.region_name = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] glance.split_loggers = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] glance.timeout = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.backend_availability_zone = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.chap_password = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.chap_username = {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.disk_geometry = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.driver_client_cert = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.driver_client_cert_key = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.driver_data_namespace = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.driver_use_ssl = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.extra_capabilities = {} {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.filter_function = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.goodness_function = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.iscsi_target_flags = {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.iscsi_write_cache = on {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.iser_helper = tgtadm {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.iser_ip_address = 192.168.122.196 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.iser_port = 3260 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.nas_host = {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.nas_login = admin {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.nas_mount_options = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.nas_password = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.nas_private_key = {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.nas_share_path = {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.num_shell_tries = 3 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.quobyte_volume_url = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.replication_device = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.report_discard_supported = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.reserved_percentage = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.target_helper = tgtadm {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.target_ip_address = 192.168.122.196 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.target_port = 3260 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.target_protocol = iscsi {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.trace_flags = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.unique_fqdn_network = True {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.use_chap_auth = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.volume_backend_name = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.volume_clear = zero {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.volume_clear_ionice = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.volume_clear_size = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_reports.file_event_handler = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_reports.log_dir = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.backend_availability_zone = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.backend_host = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.chap_password = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.chap_username = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.chiscsi_conf = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.disk_geometry = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.driver_client_cert = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.driver_data_namespace = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.driver_use_ssl = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.extra_capabilities = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.filter_function = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.goodness_function = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.iser_helper = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.iser_ip_address = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.iser_port = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.iser_target_prefix = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.nas_host = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.nas_login = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.nas_mount_options = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.nas_password = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.nas_private_key = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.nas_share_path = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.nas_ssh_port = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.num_shell_tries = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.nvmet_port_id = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.replication_device = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.report_discard_supported = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.reserved_percentage = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.scst_target_driver = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.storage_protocol = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.target_helper = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.target_ip_address = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.target_port = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.target_prefix = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.target_protocol = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.trace_flags = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.use_chap_auth = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.volume_clear = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.volume_clear_size = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] QuobyteHD.volumes_dir = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83941]: DEBUG cinder.volume.drivers.quobyte [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83941) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 17:07:22 devstack cinder-volume[83941]: WARNING cinder.volume.drivers.quobyte [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 17:07:22 devstack cinder-volume[83941]: WARNING cinder.volume.drivers.quobyte [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83941]: DEBUG oslo_concurrency.processutils [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Running cmd (subprocess): mount.quobyte {{(pid=83941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.ssl = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_notifications.driver = [] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_notifications.retry = -1 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] key_manager.fixed_key = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican.barbican_api_version = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican.barbican_endpoint = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican.barbican_endpoint_type = public {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican.barbican_region_name = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican.cafile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican.certfile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican.collect_timing = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican.insecure = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican.keyfile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican.number_of_retries = 60 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican.retry_delay = 1 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican.send_service_user_token = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican.split_loggers = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican.timeout = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican.verify_ssl = True {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican.verify_ssl_path = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican_service_user.auth_section = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican_service_user.auth_type = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican_service_user.cafile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican_service_user.certfile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican_service_user.collect_timing = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican_service_user.insecure = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican_service_user.keyfile = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican_service_user.split_loggers = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] barbican_service_user.timeout = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] vault.approle_role_id = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] vault.approle_secret_id = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] vault.kv_mountpoint = secret {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] vault.kv_path = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] vault.kv_version = 2 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] vault.namespace = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] vault.root_token_id = **** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] vault.ssl_ca_crt_file = None {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] vault.timeout = 60.0 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] vault.use_ssl = False {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:22 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] ******************************************************************************** {{(pid=83658) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 17:07:22 devstack quobyte-client[83950]: Reading configuration file: /etc/quobyte/client.cfg Apr 29 17:07:22 devstack quobyte-client[83950]: Invalid parameters found, error: missing mount point. Apr 29 17:07:22 devstack quobyte-client[83950]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 29 17:07:22 devstack quobyte-client[83950]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 29 17:07:22 devstack cinder-volume[83941]: DEBUG oslo_concurrency.processutils [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] CMD "mount.quobyte" returned: 1 in 0.084s {{(pid=83941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:07:22 devstack cinder-volume[83941]: DEBUG oslo_concurrency.lockutils [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:07:22 devstack cinder-volume[83941]: DEBUG oslo_concurrency.lockutils [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:07:22 devstack cinder-volume[83941]: DEBUG cinder.volume.drivers.quobyte [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=83941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:07:22 devstack cinder-volume[83941]: INFO cinder.volume.drivers.quobyte [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 ... Apr 29 17:07:22 devstack cinder-volume[83941]: DEBUG oslo_concurrency.processutils [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 -c /etc/quobyte/client-cinder.cfg {{(pid=83941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:07:22 devstack sudo[83961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 -c /etc/quobyte/client-cinder.cfg Apr 29 17:07:22 devstack sudo[83961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:07:23 devstack sudo[83961]: pam_unix(sudo:session): session closed for user root Apr 29 17:07:23 devstack cinder-volume[83941]: DEBUG oslo_concurrency.processutils [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.741s {{(pid=83941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:07:23 devstack cinder-volume[83941]: INFO cinder.volume.drivers.quobyte [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 succeeded Apr 29 17:07:23 devstack cinder-volume[83941]: DEBUG cinder.volume.drivers.quobyte [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=83941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:07:23 devstack cinder-volume[83941]: DEBUG oslo_concurrency.lockutils [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.756s {{(pid=83941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:07:23 devstack cinder-volume[83941]: DEBUG oslo_concurrency.processutils [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=83941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:07:23 devstack sudo[84041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:07:23 devstack sudo[84041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:07:24 devstack sudo[84041]: pam_unix(sudo:session): session closed for user root Apr 29 17:07:24 devstack cinder-volume[83941]: DEBUG oslo_concurrency.processutils [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.654s {{(pid=83941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:07:24 devstack cinder-volume[83941]: INFO cinder.volume.driver [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 17:07:24 devstack cinder-volume[83941]: DEBUG cinder.volume.driver [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5835762023926, 'free_capacity_gb': 1775.5835762023926, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83941) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 17:07:24 devstack cinder-volume[83941]: DEBUG oslo_db.sqlalchemy.engines [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83941) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 17:07:24 devstack cinder-volume[83941]: DEBUG dbcounter [-] [83941] Writer thread running {{(pid=83941) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 17:07:24 devstack cinder-volume[83941]: DEBUG cinder.db.sqlalchemy.api [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Building query based on filter {{(pid=83941) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 17:07:24 devstack cinder-volume[83941]: DEBUG cinder.image.image_utils [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83941) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 17:07:24 devstack cinder-volume[83941]: INFO cinder.keymgr.migration [None req-a51bd24d-24da-4ac4-91c7-9975aac603ac None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 17:07:24 devstack cinder-volume[83941]: DEBUG oslo_concurrency.lockutils [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:07:24 devstack cinder-volume[83941]: DEBUG oslo_concurrency.lockutils [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:07:24 devstack cinder-volume[83941]: DEBUG cinder.volume.drivers.quobyte [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=83941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:07:24 devstack cinder-volume[83941]: DEBUG cinder.volume.drivers.quobyte [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=83941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:07:24 devstack cinder-volume[83941]: DEBUG oslo_concurrency.lockutils [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:07:24 devstack cinder-volume[83941]: DEBUG oslo_concurrency.processutils [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=83941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:07:24 devstack sudo[84069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:07:24 devstack sudo[84069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:07:25 devstack sudo[84069]: pam_unix(sudo:session): session closed for user root Apr 29 17:07:25 devstack cinder-volume[83941]: DEBUG oslo_concurrency.processutils [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.636s {{(pid=83941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:07:25 devstack cinder-volume[83941]: DEBUG cinder.manager [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Notifying Schedulers of capabilities ... {{(pid=83941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:07:25 devstack cinder-volume[83941]: INFO cinder.volume.manager [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Driver initialization completed successfully. Apr 29 17:07:25 devstack cinder-volume[83941]: INFO cinder.manager [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Initiating service 3 cleanup Apr 29 17:07:25 devstack cinder-volume[83941]: INFO cinder.manager [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Service 3 cleanup completed. Apr 29 17:07:25 devstack cinder-volume[83941]: DEBUG cinder.service [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Creating RPC server for service cinder-volume {{(pid=83941) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 17:07:25 devstack cinder-volume[83941]: DEBUG cinder.service [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83941) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 17:07:25 devstack cinder-volume[83941]: INFO cinder.volume.manager [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 17:07:25 devstack cinder-volume[83941]: DEBUG oslo_concurrency.lockutils [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:07:25 devstack cinder-volume[83941]: DEBUG oslo_concurrency.lockutils [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:07:25 devstack cinder-volume[83941]: DEBUG cinder.volume.drivers.quobyte [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=83941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:07:25 devstack cinder-volume[83941]: DEBUG cinder.volume.drivers.quobyte [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=83941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:07:25 devstack cinder-volume[83941]: DEBUG oslo_concurrency.lockutils [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:07:25 devstack cinder-volume[83941]: DEBUG oslo_concurrency.processutils [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=83941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:07:25 devstack sudo[84089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:07:25 devstack sudo[84089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:07:26 devstack sudo[84089]: pam_unix(sudo:session): session closed for user root Apr 29 17:07:26 devstack cinder-volume[83941]: DEBUG oslo_concurrency.processutils [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.826s {{(pid=83941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:07:26 devstack cinder-volume[83941]: INFO cinder.volume.manager [None req-4641b3c2-189f-4cb8-b410-06c1fa1f9184 None None] Driver post RPC initialization completed successfully. Apr 29 17:07:30 devstack cinder-volume[83941]: DEBUG oslo_concurrency.lockutils [None req-2141931d-e72e-446f-b79e-32d6c635db65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:07:30 devstack cinder-volume[83941]: DEBUG oslo_concurrency.lockutils [None req-2141931d-e72e-446f-b79e-32d6c635db65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:07:30 devstack cinder-volume[83941]: DEBUG cinder.volume.drivers.quobyte [None req-2141931d-e72e-446f-b79e-32d6c635db65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=83941) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:07:30 devstack cinder-volume[83941]: DEBUG cinder.volume.drivers.quobyte [None req-2141931d-e72e-446f-b79e-32d6c635db65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=83941) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:07:30 devstack cinder-volume[83941]: DEBUG oslo_concurrency.lockutils [None req-2141931d-e72e-446f-b79e-32d6c635db65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83941) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:07:30 devstack cinder-volume[83941]: DEBUG oslo_concurrency.processutils [None req-2141931d-e72e-446f-b79e-32d6c635db65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=83941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:07:30 devstack sudo[84295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:07:30 devstack sudo[84295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:07:30 devstack cinder-volume[83658]: INFO oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] Caught SIGTERM, stopping children Apr 29 17:07:30 devstack cinder-volume[83658]: DEBUG oslo_concurrency.lockutils [None req-955969d0-4670-416a-a256-aac103625564 None None] Acquiring lock "singleton_lock" {{(pid=83658) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 17:07:30 devstack cinder-volume[83658]: DEBUG oslo_concurrency.lockutils [None req-955969d0-4670-416a-a256-aac103625564 None None] Acquired lock "singleton_lock" {{(pid=83658) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 17:07:30 devstack cinder-volume[83658]: DEBUG oslo_concurrency.lockutils [None req-955969d0-4670-416a-a256-aac103625564 None None] Releasing lock "singleton_lock" {{(pid=83658) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 17:07:30 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] Stop services. {{(pid=83658) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 17:07:30 devstack cinder-volume[83658]: DEBUG oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] Killing children. {{(pid=83658) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 17:07:30 devstack cinder-volume[83658]: INFO oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] Waiting on 1 children to exit Apr 29 17:07:31 devstack sudo[84295]: pam_unix(sudo:session): session closed for user root Apr 29 17:07:31 devstack cinder-volume[83941]: DEBUG oslo_concurrency.processutils [None req-2141931d-e72e-446f-b79e-32d6c635db65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.697s {{(pid=83941) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:07:31 devstack cinder-volume[83941]: DEBUG cinder.manager [None req-2141931d-e72e-446f-b79e-32d6c635db65 None None] Notifying Schedulers of capabilities ... {{(pid=83941) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2141931d-e72e-446f-b79e-32d6c635db65 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2141931d-e72e-446f-b79e-32d6c635db65 None None] Unable to connect to AMQP server on 192.168.122.196:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server [None req-2141931d-e72e-446f-b79e-32d6c635db65 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.196:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1140, in ensure Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1129, in execute_method Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server method() Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1591, in _publish Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server self._producer.publish( Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server return _publish( Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server listener(*args) Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server raise error_for_code( Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 203, in _publish_service_capabilities Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 154, in cast Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server self.transport._send(self.target, msg_ctxt, msg, Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 800, in send Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 775, in _send Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1710, in fanout_send Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1540, in _ensure_publishing Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1162, in ensure Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.196:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Apr 29 17:07:31 devstack cinder-volume[83941]: ERROR oslo_messaging.rpc.server Apr 29 17:07:33 devstack cinder-volume[83941]: DEBUG oslo_concurrency.lockutils [None req-955969d0-4670-416a-a256-aac103625564 None None] Acquiring lock "singleton_lock" {{(pid=83941) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 17:07:33 devstack cinder-volume[83941]: DEBUG oslo_concurrency.lockutils [None req-955969d0-4670-416a-a256-aac103625564 None None] Acquired lock "singleton_lock" {{(pid=83941) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 17:07:33 devstack cinder-volume[83941]: DEBUG oslo_concurrency.lockutils [None req-955969d0-4670-416a-a256-aac103625564 None None] Releasing lock "singleton_lock" {{(pid=83941) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 17:07:33 devstack cinder-volume[83941]: WARNING amqp [None req-955969d0-4670-416a-a256-aac103625564 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 17:07:33 devstack cinder-volume[83941]: WARNING amqp [None req-955969d0-4670-416a-a256-aac103625564 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 17:07:33 devstack cinder-volume[83658]: INFO oslo_service.backend._eventlet.service [None req-955969d0-4670-416a-a256-aac103625564 None None] Child 83941 exited with status 0 Apr 29 17:07:36 devstack cinder-volume[84307]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=84307) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 17:07:36 devstack cinder-volume[84307]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=84307) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 17:07:36 devstack cinder-volume[84307]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=84307) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 17:07:37 devstack cinder-volume[84307]: INFO dbcounter [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] Registered counter for database cinder Apr 29 17:07:37 devstack cinder-volume[84307]: DEBUG oslo_db.sqlalchemy.engines [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84307) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 17:07:37 devstack cinder-volume[84307]: DEBUG dbcounter [-] [84307] Writer thread running {{(pid=84307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 17:07:37 devstack cinder-volume[84307]: INFO cinder.rpc [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 17:07:37 devstack cinder-volume[84307]: INFO cinder.rpc [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 17:07:37 devstack cinder-volume[84307]: DEBUG oslo_db.sqlalchemy.engines [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84307) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 17:07:38 devstack cinder-volume[84307]: INFO cinder.volume.manager [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] Determined volume DB was empty at startup. Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG cinder.volume.manager [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] Cinder Volume DB check: vol_db_empty=True {{(pid=84307) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 17:07:38 devstack cinder-volume[84307]: WARNING stevedore.named [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 17:07:38 devstack cinder-volume[84307]: WARNING castellan.key_manager [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 17:07:38 devstack cinder-volume[84307]: WARNING cinder.keymgr.conf_key_mgr [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 17:07:38 devstack cinder-volume[84307]: INFO cinder.volume.manager [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_db.sqlalchemy.engines [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84307) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 17:07:38 devstack cinder-volume[84307]: INFO oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] Starting 1 workers Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] Started child 84547 {{(pid=84307) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] Full set of CONF: {{(pid=84307) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] ******************************************************************************** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] Configuration options gathered from: {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] ================================================================================ {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] allow_availability_zone_fallback = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] allow_compression_on_image_upload = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] allowed_direct_url_schemes = [] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] api_rate_limit = True {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84547]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] auth_strategy = keystone {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_availability_zone = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_host = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_name = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_stats_polling_interval = 60 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backup_api_class = cinder.backup.api.API {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backup_name_template = backup-%s {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backup_use_same_host = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backup_use_temp_snapshot = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] chap_password = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] chap_username = {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cinder_internal_tenant_project_id = 771b3bf0fd794a929c2d1c13a445f137 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cinder_internal_tenant_user_id = 80355330dc574723826cb3f79a637bd0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cluster = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] compression_format = gzip {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] compute_api_class = cinder.compute.nova.API {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] config_dir = [] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] config_source = [] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] control_exchange = openstack {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] debug = True {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] default_availability_zone = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] default_group_type = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] default_volume_type = QuobyteHD {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] disk_geometry = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] driver_client_cert = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] driver_client_cert_key = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] driver_data_namespace = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] driver_ssl_cert_path = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] driver_ssl_cert_verify = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] driver_use_ssl = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] enable_new_services = True {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] enable_unsupported_driver = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] enabled_backends = ['QuobyteHD'] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] enforce_multipath_for_image_xfer = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] filter_function = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] glance_api_insecure = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] glance_api_servers = ['http://192.168.122.196/image'] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] glance_api_ssl_compression = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] glance_ca_certificates_file = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] glance_catalog_info = image:glance:publicURL {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] glance_certfile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] glance_keyfile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] glance_num_retries = 3 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] glance_request_timeout = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] goodness_function = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] graceful_shutdown_timeout = 5 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] group_api_class = cinder.group.api.API {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] host = devstack {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] image_compress_on_upload = True {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] image_conversion_address_space_limit = 1 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] image_conversion_cpu_limit = 60 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] image_conversion_disable = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] image_upload_use_cinder_backend = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] image_upload_use_internal_tenant = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] image_volume_cache_enabled = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] image_volume_cache_max_count = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] image_volume_cache_max_size_gb = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] init_host_max_objects_retrieval = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] instance_format = [instance: %(uuid)s] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] iscsi_target_flags = {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] iscsi_write_cache = on {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] iser_helper = tgtadm {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] iser_ip_address = 192.168.122.196 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] iser_port = 3260 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] log_color = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] log_config_append = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] log_dir = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] log_file = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] log_options = True {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] log_rotate_interval = 1 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] log_rotate_interval_type = days {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] log_rotation_type = none {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=84547) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] max_age = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] max_logfile_count = 30 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] max_logfile_size_mb = 200 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] max_over_subscription_ratio = 20.0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] message_reap_interval = 86400 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] message_ttl = 2592000 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] migration_create_volume_timeout_secs = 300 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] monkey_patch = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] monkey_patch_modules = [] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] my_ip = 192.168.122.196 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] no_snapshot_gb_quota = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] num_iser_scan_tries = 3 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] num_shell_tries = 3 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] num_volume_device_scan_tries = 3 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] nvmeof_conn_info_version = 1 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] nvmet_ns_id = 10 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] nvmet_port_id = 1 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] osapi_max_limit = 1000 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] osapi_volume_ext_list = [] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] osapi_volume_listen = 0.0.0.0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] osapi_volume_listen_port = 8776 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] osapi_volume_use_ssl = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] osapi_volume_workers = 2 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] per_volume_size_limit = -1 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] periodic_fuzzy_delay = 60 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] periodic_interval = 60 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] project_id_regex = [0-9a-f\-]+ {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] public_endpoint = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] publish_errors = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] quota_backup_gigabytes = 1000 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] quota_backups = 10 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] quota_gigabytes = 1000 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] quota_groups = 10 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] quota_snapshots = 10 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] quota_volumes = 10 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] rate_limit_burst = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] rate_limit_except_level = CRITICAL {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] rate_limit_interval = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] reinit_driver_count = 3 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] replication_device = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] report_discard_supported = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] report_interval = 120 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] reservation_clean_interval = 86400 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] reservation_expire = 86400 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] reserved_image_namespaces = [] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] reserved_percentage = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] rpc_response_timeout = 120 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] run_external_periodic_tasks = True {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] scst_target_driver = iscsi {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] scst_target_iqn_name = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] service_down_time = 720 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] shell_completion = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] snapshot_name_template = snapshot-%s {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] split_loggers = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] state_path = /opt/stack/data/cinder {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] storage_availability_zone = nova {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] storage_protocol = iSCSI {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] syslog_log_facility = LOG_USER {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] target_helper = lioadm {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] target_ip_address = 192.168.122.196 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] target_port = 3260 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] target_protocol = iscsi {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] target_secondary_ip_addresses = [] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] trace_flags = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] transfer_api_class = cinder.transfer.api.API {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] transport_url = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] until_refresh = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] use_chap_auth = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] use_default_quota_class = True {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] use_journal = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] use_json = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] use_multipath_for_image_xfer = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] use_stderr = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] use_syslog = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] verify_glance_signatures = enabled {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] volume_api_class = cinder.volume.api.API {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] volume_backend_name = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] volume_clear = zero {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] volume_clear_ionice = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] volume_clear_size = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] volume_copy_bps_limit = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] volume_dd_blocksize = 1M {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] volume_name_template = volume-%s {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] volume_service_inithost_offload = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] volume_usage_audit_period = month {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] zoning_mode = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] os_brick.lightos_discovery_client_address = localhost {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] os_brick.wait_mpath_device_interval = 1 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_concurrency.disable_process_locking = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.admin_password = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.admin_tenant_name = admin {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack quobyte-client[84568]: Reading configuration file: /etc/quobyte/client.cfg Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.admin_token = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.admin_user = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.auth_admin_prefix = {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.auth_port = 35357 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.auth_protocol = https {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.auth_section = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack quobyte-client[84568]: Invalid parameters found, error: missing mount point. Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.auth_type = password {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.auth_uri = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.auth_version = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.cache = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.certfile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.delay_auth_decision = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack quobyte-client[84568]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 29 17:07:38 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=84547) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 17:07:38 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.quobyte [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 17:07:38 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.quobyte [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 17:07:38 devstack quobyte-client[84568]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.http_connect_timeout = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Running cmd (subprocess): mount.quobyte {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.identity_uri = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.include_service_catalog = True {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.insecure = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.interface = public {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.keyfile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.memcache_password = {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack sudo[84569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.memcache_secret_key = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack sudo[84569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.memcache_security_strategy = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.memcache_username = {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.region_name = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.service_token_roles_required = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.service_type = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.token_cache_time = 300 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.196/identity {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.backend = dogpile.cache.null {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.backend_argument = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.backend_expiration_time = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.config_prefix = cache.oslo {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.debug_cache_backend = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.enable_retry_client = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.enable_socket_keepalive = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.enabled = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.enforce_fips_mode = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.expiration_time = 600 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.hashclient_dead_timeout = 60.0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.hashclient_retry_attempts = 2 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.hashclient_retry_timeout = 1.0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.memcache_dead_retry = 300 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.memcache_pool_maxsize = 10 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.memcache_pool_unused_timeout = 60 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.memcache_sasl_enabled = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.memcache_servers = ['localhost:11211'] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.password = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.proxies = [] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.redis_db = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.redis_sentinel_service_name = mymaster {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.redis_server = localhost:6379 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.retry_attempts = 2 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.retry_delay = 0.0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.socket_keepalive_count = 1 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.socket_keepalive_idle = 1 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.socket_keepalive_interval = 1 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.socket_timeout = 1.0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.tls_allowed_ciphers = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.tls_cafile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.tls_certfile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.tls_enabled = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.tls_keyfile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cache.username = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] coordination.backend_url = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.asyncio_connection = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.asyncio_slave_connection = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.backend = sqlalchemy {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.connection = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.connection_debug = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.connection_parameters = {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.connection_recycle_time = 3600 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.connection_trace = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.db_inc_retry_interval = True {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.db_max_retries = 20 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.db_max_retry_interval = 10 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.db_retry_interval = 1 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.max_overflow = 50 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.max_pool_size = 5 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.max_retries = 10 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.mysql_sql_mode = TRADITIONAL {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.mysql_wsrep_sync_wait = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.pool_timeout = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.retry_interval = 10 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.slave_connection = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.sqlite_synchronous = True {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.synchronous_reader = True {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] database.use_db_reconnect = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_metrics.metrics_process_name = {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] profiler.connection_string = messaging:// {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] profiler.enabled = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] profiler.es_doc_type = notification {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] profiler.es_scroll_size = 10000 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] profiler.es_scroll_time = 2m {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] profiler.filter_error_trace = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] profiler.hmac_keys = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] profiler.sentinel_service_name = mymaster {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] profiler.socket_timeout = 0.1 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] profiler.trace_requests = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] profiler.trace_sqlalchemy = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] profiler_jaeger.process_tags = {} {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] profiler_jaeger.service_name_prefix = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] profiler_otlp.service_name_prefix = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_policy.enforce_new_defaults = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: WARNING oslo_config.cfg [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_policy.enforce_scope = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_policy.policy_default_rule = default {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_policy.policy_file = policy.yaml {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_policy.remote_timeout = 60.0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] privsep_osbrick.capabilities = [21, 2] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] privsep_osbrick.group = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] privsep_osbrick.helper_command = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] privsep_osbrick.log_daemon_traceback = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] privsep_osbrick.thread_pool_size = 4 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] privsep_osbrick.user = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cinder_sys_admin.group = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cinder_sys_admin.helper_command = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] cinder_sys_admin.user = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] service_user.auth_section = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] service_user.auth_type = password {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] service_user.cafile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] service_user.certfile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] service_user.collect_timing = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] service_user.insecure = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] service_user.keyfile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] service_user.send_service_user_token = True {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] service_user.split_loggers = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] service_user.timeout = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] glance.auth_section = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] glance.auth_type = password {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] glance.certfile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] glance.collect_timing = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] glance.insecure = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] glance.keyfile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] glance.region_name = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] glance.split_loggers = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] glance.timeout = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.backend_availability_zone = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.chap_password = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.chap_username = {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.disk_geometry = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.driver_client_cert = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.driver_client_cert_key = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.driver_data_namespace = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.driver_ssl_cert_path = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.driver_use_ssl = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.enable_unsupported_driver = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.extra_capabilities = {} {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.filter_function = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.goodness_function = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.image_volume_cache_enabled = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.iscsi_target_flags = {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.iscsi_write_cache = on {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.iser_helper = tgtadm {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.iser_ip_address = 192.168.122.196 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.iser_port = 3260 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.nas_host = {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.nas_login = admin {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:38 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.nas_mount_options = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.nas_password = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.nas_private_key = {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.nas_secure_file_operations = auto {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.nas_share_path = {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.nas_ssh_port = 22 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.nas_volume_prov_type = thin {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.num_shell_tries = 3 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.nvmet_ns_id = 10 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.nvmet_port_id = 1 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.quobyte_client_cfg = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.quobyte_volume_url = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.replication_device = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.report_discard_supported = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.reserved_percentage = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.scst_target_driver = iscsi {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.scst_target_iqn_name = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.storage_protocol = iSCSI {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.target_helper = tgtadm {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.target_ip_address = 192.168.122.196 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.target_port = 3260 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.target_protocol = iscsi {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.trace_flags = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.unique_fqdn_network = True {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.use_chap_auth = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.volume_backend_name = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.volume_clear = zero {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.volume_clear_ionice = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.volume_clear_size = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_reports.file_event_handler = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_reports.file_event_handler_interval = 1 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_reports.log_dir = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.backend_availability_zone = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.backend_host = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.chap_password = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.chap_username = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.chiscsi_conf = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.disk_geometry = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.driver_client_cert = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.driver_client_cert_key = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.driver_data_namespace = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.driver_use_ssl = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] CMD "mount.quobyte" returned: 1 in 0.108s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.enable_unsupported_driver = True {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.extra_capabilities = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.filter_function = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.goodness_function = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.iscsi_target_flags = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.iscsi_write_cache = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.iser_helper = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.iser_ip_address = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.iser_port = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.iser_target_prefix = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.nas_host = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.nas_login = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.nas_mount_options = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.nas_password = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.nas_private_key = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.nas_secure_file_operations = false {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.nas_share_path = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.nas_ssh_port = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.nas_volume_prov_type = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.num_iser_scan_tries = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.num_shell_tries = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.nvmet_ns_id = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.nvmet_port_id = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack sudo[84569]: pam_unix(sudo:session): session closed for user root Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.replication_device = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.report_discard_supported = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.reserved_percentage = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.scst_target_driver = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.scst_target_iqn_name = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.storage_protocol = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.target_helper = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.target_ip_address = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.target_port = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.target_prefix = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.target_protocol = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.trace_flags = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.unique_fqdn_network = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.use_chap_auth = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.volume_clear = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.volume_clear_ionice = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.volume_clear_size = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.volume_dd_blocksize = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] QuobyteHD.volumes_dir = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:07:39 devstack sudo[84573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.hostname = devstack {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack sudo[84573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.ssl = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.ssl_version = {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_notifications.driver = [] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_notifications.retry = -1 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] oslo_messaging_notifications.transport_url = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] key_manager.fixed_key = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican.barbican_api_version = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican.barbican_endpoint = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican.barbican_endpoint_type = public {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican.barbican_region_name = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican.cafile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican.certfile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican.collect_timing = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican.insecure = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican.keyfile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican.number_of_retries = 60 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican.retry_delay = 1 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican.send_service_user_token = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican.split_loggers = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican.timeout = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican.verify_ssl = True {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican.verify_ssl_path = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican_service_user.auth_section = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican_service_user.auth_type = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican_service_user.cafile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican_service_user.certfile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican_service_user.collect_timing = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican_service_user.insecure = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican_service_user.keyfile = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican_service_user.split_loggers = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] barbican_service_user.timeout = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] vault.approle_role_id = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] vault.approle_secret_id = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] vault.kv_mountpoint = secret {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] vault.kv_path = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] vault.kv_version = 2 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] vault.namespace = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] vault.root_token_id = **** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] vault.ssl_ca_crt_file = None {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] vault.timeout = 60.0 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] vault.use_ssl = False {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 17:07:39 devstack cinder-volume[84307]: DEBUG oslo_service.backend._eventlet.service [None req-405b16fa-c79d-452a-95af-95aea3f9a8de None None] ******************************************************************************** {{(pid=84307) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.682s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:07:39 devstack cinder-volume[84547]: INFO cinder.volume.driver [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG cinder.volume.driver [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5835762023926, 'free_capacity_gb': 1775.5835762023926, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84547) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG oslo_db.sqlalchemy.engines [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84547) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writer thread running {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG cinder.db.sqlalchemy.api [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Building query based on filter {{(pid=84547) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84547) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:07:39 devstack cinder-volume[84547]: INFO cinder.keymgr.migration [None req-703baa3f-b8ac-4218-b26f-b7384618821b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 17:07:39 devstack sudo[84573]: pam_unix(sudo:session): session closed for user root Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.573s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:07:39 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Driver initialization completed successfully. Apr 29 17:07:39 devstack cinder-volume[84547]: INFO cinder.manager [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Initiating service 3 cleanup Apr 29 17:07:39 devstack cinder-volume[84547]: INFO cinder.manager [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Service 3 cleanup completed. Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG cinder.service [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Creating RPC server for service cinder-volume {{(pid=84547) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG cinder.service [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84547) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 17:07:39 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:07:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:07:39 devstack sudo[84578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:07:39 devstack sudo[84578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:07:40 devstack sudo[84578]: pam_unix(sudo:session): session closed for user root Apr 29 17:07:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.577s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:07:40 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-391e0d5b-eaec-4096-b524-2d4f74633436 None None] Driver post RPC initialization completed successfully. Apr 29 17:07:48 devstack cinder-volume[84307]: DEBUG dbcounter [-] [84307] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=84307) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:07:49 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:07:50 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=3 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:08:37 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:08:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Flow 'volume_create_manager' (085436d5-9cdb-4f62-bb81-a03d0eb2e9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:08:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c55868fa-4d62-409f-ae8d-52332246cb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:08:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c55868fa-4d62-409f-ae8d-52332246cb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1347238461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f631404-f54e-413f-91db-d7670497edde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327014744724456db2b79a0478e817dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:08:38Z,use_quota=True,user_id='622b9875c9f44216bd8c45101b387070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:08:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222f66f6-1381-4555-ac54-a2c60f2dd5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:08:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222f66f6-1381-4555-ac54-a2c60f2dd5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:08:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb87d8b2-eee1-42ae-ac96-24f8e8e0c9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:08:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb87d8b2-eee1-42ae-ac96-24f8e8e0c9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f631404-f54e-413f-91db-d7670497edde', 'volume_name': 'volume-3f631404-f54e-413f-91db-d7670497edde', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:08:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553ac139-0d38-4b23-be0b-fefcd9a120e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:08:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553ac139-0d38-4b23-be0b-fefcd9a120e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:08:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ae7b01-d458-4f36-a093-3d4dee46bf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:08:37 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Volume 3f631404-f54e-413f-91db-d7670497edde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f631404-f54e-413f-91db-d7670497edde', 'volume_size': 1} Apr 29 17:08:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:08:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:08:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1347238461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f631404-f54e-413f-91db-d7670497edde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='327014744724456db2b79a0478e817dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:08:38Z,use_quota=True,user_id='622b9875c9f44216bd8c45101b387070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:08:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Creating volume 3f631404-f54e-413f-91db-d7670497edde {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:08:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:08:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:08:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:08:38 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:08:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:08:38 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:08:38 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:08:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f631404-f54e-413f-91db-d7670497edde 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:08:38 devstack sudo[84682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f631404-f54e-413f-91db-d7670497edde 1073741824 Apr 29 17:08:38 devstack sudo[84682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:08:38 devstack sudo[84682]: pam_unix(sudo:session): session closed for user root Apr 29 17:08:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f631404-f54e-413f-91db-d7670497edde 1073741824" returned: 0 in 0.979s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:08:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f631404-f54e-413f-91db-d7670497edde {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:08:39 devstack sudo[85001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f631404-f54e-413f-91db-d7670497edde Apr 29 17:08:39 devstack sudo[85001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:08:39 devstack sudo[85001]: pam_unix(sudo:session): session closed for user root Apr 29 17:08:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f631404-f54e-413f-91db-d7670497edde" returned: 0 in 0.706s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:08:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:08:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:08:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ae7b01-d458-4f36-a093-3d4dee46bf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f631404-f54e-413f-91db-d7670497edde', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:08:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (844a591e-d201-46ca-914a-d7c1fb815950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:08:39 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Volume volume-3f631404-f54e-413f-91db-d7670497edde (3f631404-f54e-413f-91db-d7670497edde): created successfully Apr 29 17:08:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (844a591e-d201-46ca-914a-d7c1fb815950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:08:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Flow 'volume_create_manager' (085436d5-9cdb-4f62-bb81-a03d0eb2e9be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:08:39 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-8de2c026-00de-42d6-98fc-c8c11d16804b tempest-TaggedAttachmentsTest-1683631342 None] Created volume successfully. Apr 29 17:08:49 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:08:49 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Flow 'volume_create_manager' (76e19910-b183-4adb-a6c8-dc2119797e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2ea8d4-367b-4f72-941f-888faeabad35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2ea8d4-367b-4f72-941f-888faeabad35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1282884805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a159704f-5efb-4276-b248-dfd715722b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2def9872c3884b3291cb3cba119bb818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:08:52Z,use_quota=True,user_id='456af56224ab42debf8d785b33cd24ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a973d2a-bc42-403b-be56-a8eae78a53df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a973d2a-bc42-403b-be56-a8eae78a53df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db8ccd7-4d06-4a51-94c1-8b2d9c294b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db8ccd7-4d06-4a51-94c1-8b2d9c294b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a159704f-5efb-4276-b248-dfd715722b37', 'volume_name': 'volume-a159704f-5efb-4276-b248-dfd715722b37', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3df38d0-e09e-4fe1-97fc-4e81de2ba6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3df38d0-e09e-4fe1-97fc-4e81de2ba6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5df660d-1bf1-4a35-a459-b36363a7f62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:08:52 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Volume a159704f-5efb-4276-b248-dfd715722b37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a159704f-5efb-4276-b248-dfd715722b37', 'volume_size': 1} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-1282884805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a159704f-5efb-4276-b248-dfd715722b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2def9872c3884b3291cb3cba119bb818',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:08:52Z,use_quota=True,user_id='456af56224ab42debf8d785b33cd24ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Creating volume a159704f-5efb-4276-b248-dfd715722b37 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:08:52 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:08:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a159704f-5efb-4276-b248-dfd715722b37 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:08:52 devstack sudo[85044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a159704f-5efb-4276-b248-dfd715722b37 1073741824 Apr 29 17:08:52 devstack sudo[85044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:08:53 devstack sudo[85044]: pam_unix(sudo:session): session closed for user root Apr 29 17:08:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a159704f-5efb-4276-b248-dfd715722b37 1073741824" returned: 0 in 0.889s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:08:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a159704f-5efb-4276-b248-dfd715722b37 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:08:53 devstack sudo[85050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a159704f-5efb-4276-b248-dfd715722b37 Apr 29 17:08:53 devstack sudo[85050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:08:54 devstack sudo[85050]: pam_unix(sudo:session): session closed for user root Apr 29 17:08:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a159704f-5efb-4276-b248-dfd715722b37" returned: 0 in 0.904s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:08:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:08:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:08:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5df660d-1bf1-4a35-a459-b36363a7f62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a159704f-5efb-4276-b248-dfd715722b37', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:08:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0b2f92-62d1-4911-9dea-a6eddcbcdb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:08:54 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Volume volume-a159704f-5efb-4276-b248-dfd715722b37 (a159704f-5efb-4276-b248-dfd715722b37): created successfully Apr 29 17:08:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de0b2f92-62d1-4911-9dea-a6eddcbcdb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:08:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Flow 'volume_create_manager' (76e19910-b183-4adb-a6c8-dc2119797e88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:08:54 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-00b77efc-75bc-4a22-9f8c-716c20ef3e2b tempest-VolumesAssistedSnapshotsTest-808181805 None] Created volume successfully. Apr 29 17:09:04 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:09:04 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=5,cinder:SELECT=1,cinder:DELETE=1 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:09:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:09:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:09:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:09:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:09:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:09:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:09:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:09:05 devstack sudo[85129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:09:05 devstack sudo[85129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:09:06 devstack sudo[85129]: pam_unix(sudo:session): session closed for user root Apr 29 17:09:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.990s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:09:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Flow 'volume_create_manager' (784224c9-a965-4b74-88aa-cc4d37d8d9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b1ae52-2f1f-4b47-9c97-fa1d34d58228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b1ae52-2f1f-4b47-9c97-fa1d34d58228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1076798747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980bffab-b83b-4067-aa70-6e77b3f5faa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21b08ccb512499b85c4592cc9aa98d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:09:22Z,use_quota=True,user_id='896e75ae1f9a4b6a951369ba69d93ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafc4f98-d1f4-48d1-a567-0989cc30f663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aafc4f98-d1f4-48d1-a567-0989cc30f663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2da3644-1f08-47ba-973b-06b435da0b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2da3644-1f08-47ba-973b-06b435da0b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '980bffab-b83b-4067-aa70-6e77b3f5faa9', 'volume_name': 'volume-980bffab-b83b-4067-aa70-6e77b3f5faa9', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51936abb-85ab-480e-8db3-128659215bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51936abb-85ab-480e-8db3-128659215bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f6e35f-df73-42a8-ac75-7ed26099faf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:09:21 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Volume 980bffab-b83b-4067-aa70-6e77b3f5faa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-980bffab-b83b-4067-aa70-6e77b3f5faa9', 'volume_size': 1} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1076798747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=980bffab-b83b-4067-aa70-6e77b3f5faa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21b08ccb512499b85c4592cc9aa98d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:09:22Z,use_quota=True,user_id='896e75ae1f9a4b6a951369ba69d93ac1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Creating volume 980bffab-b83b-4067-aa70-6e77b3f5faa9 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:09:21 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:09:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-980bffab-b83b-4067-aa70-6e77b3f5faa9 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:09:21 devstack sudo[85353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-980bffab-b83b-4067-aa70-6e77b3f5faa9 1073741824 Apr 29 17:09:21 devstack sudo[85353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:09:23 devstack sudo[85353]: pam_unix(sudo:session): session closed for user root Apr 29 17:09:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-980bffab-b83b-4067-aa70-6e77b3f5faa9 1073741824" returned: 0 in 1.951s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:09:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-980bffab-b83b-4067-aa70-6e77b3f5faa9 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:09:24 devstack sudo[85360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-980bffab-b83b-4067-aa70-6e77b3f5faa9 Apr 29 17:09:24 devstack sudo[85360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:09:25 devstack sudo[85360]: pam_unix(sudo:session): session closed for user root Apr 29 17:09:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-980bffab-b83b-4067-aa70-6e77b3f5faa9" returned: 0 in 1.484s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:09:25 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] <== create_volume: return (3549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:09:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.558s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:09:25 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5f6e35f-df73-42a8-ac75-7ed26099faf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-980bffab-b83b-4067-aa70-6e77b3f5faa9', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:09:25 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e6b0b3-4b1f-4b57-8e8c-da2dea32929a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:09:25 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Volume volume-980bffab-b83b-4067-aa70-6e77b3f5faa9 (980bffab-b83b-4067-aa70-6e77b3f5faa9): created successfully Apr 29 17:09:25 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e6b0b3-4b1f-4b57-8e8c-da2dea32929a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:09:25 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Flow 'volume_create_manager' (784224c9-a965-4b74-88aa-cc4d37d8d9c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:09:25 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-b632f968-b315-4539-abe0-60d8b64aa2f0 tempest-VolumesAdminNegativeTest-1096691586 None] Created volume successfully. Apr 29 17:09:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Acquiring lock "cinder-980bffab-b83b-4067-aa70-6e77b3f5faa9-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:09:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Lock "cinder-980bffab-b83b-4067-aa70-6e77b3f5faa9-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:09:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Acquiring lock "cinder-quobyte-980bffab-b83b-4067-aa70-6e77b3f5faa9" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:09:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Lock "cinder-quobyte-980bffab-b83b-4067-aa70-6e77b3f5faa9" acquired by "delete_volume" :: waited 0.021s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:09:28 devstack cinder-volume[84547]: INFO oslo.privsep.daemon [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpsksh8d9d/privsep.sock'] Apr 29 17:09:28 devstack sudo[85398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpsksh8d9d/privsep.sock Apr 29 17:09:28 devstack sudo[85398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:09:31 devstack sudo[85398]: pam_unix(sudo:session): session closed for user root Apr 29 17:09:31 devstack cinder-volume[84547]: INFO oslo.privsep.daemon [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Spawned new privsep daemon via rootwrap Apr 29 17:09:31 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Accepted privsep connection to /tmp/tmpsksh8d9d/privsep.sock {{(pid=84547) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Apr 29 17:09:31 devstack cinder-volume[84547]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 29 17:09:31 devstack cinder-volume[84547]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 29 17:09:31 devstack cinder-volume[84547]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 29 17:09:31 devstack cinder-volume[84547]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85470 Apr 29 17:09:31 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1a09c6-d32d-46e6-9d0c-e927f894f399]: (2,) {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:09:31 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[331798a9-aa23-40de-89c7-83066d588b68]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:09:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-980bffab-b83b-4067-aa70-6e77b3f5faa9 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:09:32 devstack sudo[85479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-980bffab-b83b-4067-aa70-6e77b3f5faa9 Apr 29 17:09:32 devstack sudo[85479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:09:33 devstack sudo[85479]: pam_unix(sudo:session): session closed for user root Apr 29 17:09:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-980bffab-b83b-4067-aa70-6e77b3f5faa9" returned: 0 in 1.502s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:09:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-980bffab-b83b-4067-aa70-6e77b3f5faa9 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:09:33 devstack sudo[85488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-980bffab-b83b-4067-aa70-6e77b3f5faa9 Apr 29 17:09:33 devstack sudo[85488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:09:35 devstack sudo[85488]: pam_unix(sudo:session): session closed for user root Apr 29 17:09:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-980bffab-b83b-4067-aa70-6e77b3f5faa9" returned: 0 in 2.021s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:09:35 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Lock "cinder-quobyte-980bffab-b83b-4067-aa70-6e77b3f5faa9" released by "delete_volume" :: held 7.276s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:09:35 devstack cinder-volume[84547]: WARNING cinder.quota [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:09:35 devstack cinder-volume[84547]: WARNING cinder.quota [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:09:35 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Created reservations ['64341916-31ff-433c-b499-709bbdac546d', 'c6d4fa74-7422-4720-9186-f5fae1637447', '4710f18f-eb83-4ec4-83dc-ed37ded0dc37', '1e7c09f5-a063-4d3d-b63c-07af95fc2838'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:09:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:09:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:09:35 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:09:35 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:09:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:09:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:09:35 devstack sudo[85492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:09:35 devstack sudo[85492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:09:37 devstack sudo[85492]: pam_unix(sudo:session): session closed for user root Apr 29 17:09:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.331s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:09:37 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:09:37 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Deleted volume successfully. Apr 29 17:09:37 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8847ea3b-71a1-4002-bfdc-d8073cb56cc2 tempest-VolumesAdminNegativeTest-1096691586 None] Lock "cinder-980bffab-b83b-4067-aa70-6e77b3f5faa9-delete_volume" released by "delete_volume" :: held 9.156s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:09:50 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=10,cinder:UPDATE=13,cinder:INSERT=1 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:09:50 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=4,cinder:DELETE=2 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:10:01 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:10:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Flow 'volume_create_manager' (e5815318-3567-4510-a00b-a9ac26406a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:10:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fbf6a55-020c-4d48-9e8f-1dea74380433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:10:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fbf6a55-020c-4d48-9e8f-1dea74380433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2067674815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c564496-b66c-4ab7-a579-0c661993b15a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985813a5c6b945e0aba6d0e13cc967d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:10:02Z,use_quota=True,user_id='8a0ca5e0d3ef45549ac1220e8b9ffbc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:10:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd25e56a-0b75-482f-9ad0-6f1ce9e5cbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:10:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd25e56a-0b75-482f-9ad0-6f1ce9e5cbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:10:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182e4a89-a535-4905-82fe-dc1a7b88e526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:10:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182e4a89-a535-4905-82fe-dc1a7b88e526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c564496-b66c-4ab7-a579-0c661993b15a', 'volume_name': 'volume-1c564496-b66c-4ab7-a579-0c661993b15a', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:10:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6f8343-c66d-4494-9433-a8574bba6f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:10:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6f8343-c66d-4494-9433-a8574bba6f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:10:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b137dbb-ef12-457d-bbd7-745121571e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:10:02 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Volume 1c564496-b66c-4ab7-a579-0c661993b15a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c564496-b66c-4ab7-a579-0c661993b15a', 'volume_size': 1} Apr 29 17:10:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:10:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:10:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2067674815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c564496-b66c-4ab7-a579-0c661993b15a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='985813a5c6b945e0aba6d0e13cc967d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:10:02Z,use_quota=True,user_id='8a0ca5e0d3ef45549ac1220e8b9ffbc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:10:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Creating volume 1c564496-b66c-4ab7-a579-0c661993b15a {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:10:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:10:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:10:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:10:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:10:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:10:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:10:02 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:10:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c564496-b66c-4ab7-a579-0c661993b15a 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:10:02 devstack sudo[85811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c564496-b66c-4ab7-a579-0c661993b15a 1073741824 Apr 29 17:10:02 devstack sudo[85811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:10:03 devstack sudo[85811]: pam_unix(sudo:session): session closed for user root Apr 29 17:10:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c564496-b66c-4ab7-a579-0c661993b15a 1073741824" returned: 0 in 1.009s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:10:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c564496-b66c-4ab7-a579-0c661993b15a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:10:03 devstack sudo[85816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c564496-b66c-4ab7-a579-0c661993b15a Apr 29 17:10:03 devstack sudo[85816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:10:03 devstack sudo[85816]: pam_unix(sudo:session): session closed for user root Apr 29 17:10:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c564496-b66c-4ab7-a579-0c661993b15a" returned: 0 in 0.728s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:10:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:10:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:10:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b137dbb-ef12-457d-bbd7-745121571e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c564496-b66c-4ab7-a579-0c661993b15a', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:10:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c69ada8-0b07-4936-9d17-bc274fd79abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:10:03 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Volume volume-1c564496-b66c-4ab7-a579-0c661993b15a (1c564496-b66c-4ab7-a579-0c661993b15a): created successfully Apr 29 17:10:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c69ada8-0b07-4936-9d17-bc274fd79abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:10:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Flow 'volume_create_manager' (e5815318-3567-4510-a00b-a9ac26406a53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:10:03 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-b166303e-98b5-46d1-b3e9-769325e067e2 tempest-DeleteServersTestJSON-106581627 None] Created volume successfully. Apr 29 17:10:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:10:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:10:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:10:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:10:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:10:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:10:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:10:05 devstack sudo[85831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:10:05 devstack sudo[85831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:10:06 devstack sudo[85831]: pam_unix(sudo:session): session closed for user root Apr 29 17:10:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.638s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:10:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:10:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-e06d5ddb-0e85-4f10-a7d4-6f4bb13cf33a req-57bd5414-286a-4656-9212-5926669ca42b tempest-VolumesAssistedSnapshotsTest-808181805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:10:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-e06d5ddb-0e85-4f10-a7d4-6f4bb13cf33a req-57bd5414-286a-4656-9212-5926669ca42b tempest-VolumesAssistedSnapshotsTest-808181805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:10:10 devstack cinder-volume[84547]: WARNING py.warnings [req-f37aa67c-51a7-48bf-a430-5d161c11da6c req-bd47487c-3234-4c16-bbd7-9631525b0ffd tempest-DeleteServersTestJSON-106581627 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Apr 29 17:10:10 devstack cinder-volume[84547]: .first() Apr 29 17:10:10 devstack cinder-volume[84547]: Apr 29 17:10:10 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f64eb65-6d8e-47d0-b7f3-03952a68687a]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:10:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e06d5ddb-0e85-4f10-a7d4-6f4bb13cf33a req-57bd5414-286a-4656-9212-5926669ca42b tempest-VolumesAssistedSnapshotsTest-808181805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a159704f-5efb-4276-b248-dfd715722b37 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:10:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f37aa67c-51a7-48bf-a430-5d161c11da6c req-bd47487c-3234-4c16-bbd7-9631525b0ffd tempest-DeleteServersTestJSON-106581627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:10:10 devstack sudo[85860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a159704f-5efb-4276-b248-dfd715722b37 Apr 29 17:10:10 devstack sudo[85860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:10:11 devstack sudo[85860]: pam_unix(sudo:session): session closed for user root Apr 29 17:10:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e06d5ddb-0e85-4f10-a7d4-6f4bb13cf33a req-57bd5414-286a-4656-9212-5926669ca42b tempest-VolumesAssistedSnapshotsTest-808181805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a159704f-5efb-4276-b248-dfd715722b37" returned: 0 in 0.834s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:10:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-e06d5ddb-0e85-4f10-a7d4-6f4bb13cf33a req-57bd5414-286a-4656-9212-5926669ca42b tempest-VolumesAssistedSnapshotsTest-808181805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.883s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:10:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f37aa67c-51a7-48bf-a430-5d161c11da6c req-bd47487c-3234-4c16-bbd7-9631525b0ffd tempest-DeleteServersTestJSON-106581627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.805s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:10:11 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[adda96a4-c3ab-4aff-88d7-31299531b458]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:10:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f37aa67c-51a7-48bf-a430-5d161c11da6c req-bd47487c-3234-4c16-bbd7-9631525b0ffd tempest-DeleteServersTestJSON-106581627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c564496-b66c-4ab7-a579-0c661993b15a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:10:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-e06d5ddb-0e85-4f10-a7d4-6f4bb13cf33a req-57bd5414-286a-4656-9212-5926669ca42b tempest-VolumesAssistedSnapshotsTest-808181805 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-a159704f-5efb-4276-b248-dfd715722b37', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b19b1b29-98af-4b70-88f5-e588444aa306', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:10:11 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-e06d5ddb-0e85-4f10-a7d4-6f4bb13cf33a req-57bd5414-286a-4656-9212-5926669ca42b tempest-VolumesAssistedSnapshotsTest-808181805 None] attachment_update completed successfully. Apr 29 17:10:11 devstack sudo[85865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c564496-b66c-4ab7-a579-0c661993b15a Apr 29 17:10:11 devstack sudo[85865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:10:12 devstack sudo[85865]: pam_unix(sudo:session): session closed for user root Apr 29 17:10:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f37aa67c-51a7-48bf-a430-5d161c11da6c req-bd47487c-3234-4c16-bbd7-9631525b0ffd tempest-DeleteServersTestJSON-106581627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c564496-b66c-4ab7-a579-0c661993b15a" returned: 0 in 1.007s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:10:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f37aa67c-51a7-48bf-a430-5d161c11da6c req-bd47487c-3234-4c16-bbd7-9631525b0ffd tempest-DeleteServersTestJSON-106581627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.039s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:10:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f37aa67c-51a7-48bf-a430-5d161c11da6c req-bd47487c-3234-4c16-bbd7-9631525b0ffd tempest-DeleteServersTestJSON-106581627 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-1c564496-b66c-4ab7-a579-0c661993b15a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '128ea32d-a1b3-4fa2-b501-1cda980dd78b', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:10:12 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-f37aa67c-51a7-48bf-a430-5d161c11da6c req-bd47487c-3234-4c16-bbd7-9631525b0ffd tempest-DeleteServersTestJSON-106581627 None] attachment_update completed successfully. Apr 29 17:10:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-7410d892-ebc4-40f2-82ea-820684929843 req-c55645b1-1599-4df5-80b7-fb976ab53851 tempest-TaggedAttachmentsTest-1683631342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:10:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-7410d892-ebc4-40f2-82ea-820684929843 req-c55645b1-1599-4df5-80b7-fb976ab53851 tempest-TaggedAttachmentsTest-1683631342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:10:12 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb8ea42-3810-4715-919c-f83a2f40c589]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:10:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-7410d892-ebc4-40f2-82ea-820684929843 req-c55645b1-1599-4df5-80b7-fb976ab53851 tempest-TaggedAttachmentsTest-1683631342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f631404-f54e-413f-91db-d7670497edde {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:10:12 devstack sudo[85944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f631404-f54e-413f-91db-d7670497edde Apr 29 17:10:12 devstack sudo[85944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:10:13 devstack sudo[85944]: pam_unix(sudo:session): session closed for user root Apr 29 17:10:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-7410d892-ebc4-40f2-82ea-820684929843 req-c55645b1-1599-4df5-80b7-fb976ab53851 tempest-TaggedAttachmentsTest-1683631342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f631404-f54e-413f-91db-d7670497edde" returned: 0 in 1.148s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:10:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-7410d892-ebc4-40f2-82ea-820684929843 req-c55645b1-1599-4df5-80b7-fb976ab53851 tempest-TaggedAttachmentsTest-1683631342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.174s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:10:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-7410d892-ebc4-40f2-82ea-820684929843 req-c55645b1-1599-4df5-80b7-fb976ab53851 tempest-TaggedAttachmentsTest-1683631342 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-3f631404-f54e-413f-91db-d7670497edde', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc3ce3a4-4624-4934-a041-dc961c641e34', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:10:13 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-7410d892-ebc4-40f2-82ea-820684929843 req-c55645b1-1599-4df5-80b7-fb976ab53851 tempest-TaggedAttachmentsTest-1683631342 None] attachment_update completed successfully. Apr 29 17:10:18 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-4e9d26a9-b656-4f5c-813d-974337744776 req-cc821b65-3917-4399-ac3f-965e0017e31a tempest-VolumesAssistedSnapshotsTest-808181805 None] Terminate volume connection completed successfully. Apr 29 17:10:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-4e9d26a9-b656-4f5c-813d-974337744776 req-cc821b65-3917-4399-ac3f-965e0017e31a tempest-VolumesAssistedSnapshotsTest-808181805 None] Deleting attachment b19b1b29-98af-4b70-88f5-e588444aa306. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:10:20 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-2bea4541-30d2-46aa-a27f-9d99268d3e92 req-193e72d5-390c-4ba9-bda2-ad22fe5e24ad tempest-TaggedAttachmentsTest-1683631342 None] Terminate volume connection completed successfully. Apr 29 17:10:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-2bea4541-30d2-46aa-a27f-9d99268d3e92 req-193e72d5-390c-4ba9-bda2-ad22fe5e24ad tempest-TaggedAttachmentsTest-1683631342 None] Deleting attachment bc3ce3a4-4624-4934-a041-dc961c641e34. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:10:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-26a51330-e55c-4952-b296-61305707b2c1 tempest-VolumesAssistedSnapshotsTest-808181805 None] Acquiring lock "cinder-a159704f-5efb-4276-b248-dfd715722b37-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:10:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-26a51330-e55c-4952-b296-61305707b2c1 tempest-VolumesAssistedSnapshotsTest-808181805 None] Lock "cinder-a159704f-5efb-4276-b248-dfd715722b37-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:10:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-26a51330-e55c-4952-b296-61305707b2c1 tempest-VolumesAssistedSnapshotsTest-808181805 None] Acquiring lock "cinder-quobyte-a159704f-5efb-4276-b248-dfd715722b37" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:10:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-26a51330-e55c-4952-b296-61305707b2c1 tempest-VolumesAssistedSnapshotsTest-808181805 None] Lock "cinder-quobyte-a159704f-5efb-4276-b248-dfd715722b37" acquired by "delete_volume" :: waited 0.026s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:10:21 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[68be37f3-7065-4686-ae95-294cfc87dd16]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:10:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-26a51330-e55c-4952-b296-61305707b2c1 tempest-VolumesAssistedSnapshotsTest-808181805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a159704f-5efb-4276-b248-dfd715722b37 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:10:21 devstack sudo[86371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a159704f-5efb-4276-b248-dfd715722b37 Apr 29 17:10:21 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:10:21 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-edad11ba-9887-4707-ae30-f0e563003dd9 req-a982f26e-f361-4308-8594-6f0df1011fbe tempest-DeleteServersTestJSON-106581627 None] Terminate volume connection completed successfully. Apr 29 17:10:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-edad11ba-9887-4707-ae30-f0e563003dd9 req-a982f26e-f361-4308-8594-6f0df1011fbe tempest-DeleteServersTestJSON-106581627 None] Deleting attachment 128ea32d-a1b3-4fa2-b501-1cda980dd78b. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:10:21 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root Apr 29 17:10:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-26a51330-e55c-4952-b296-61305707b2c1 tempest-VolumesAssistedSnapshotsTest-808181805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a159704f-5efb-4276-b248-dfd715722b37" returned: 0 in 0.707s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:10:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-26a51330-e55c-4952-b296-61305707b2c1 tempest-VolumesAssistedSnapshotsTest-808181805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a159704f-5efb-4276-b248-dfd715722b37 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:10:21 devstack sudo[86376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a159704f-5efb-4276-b248-dfd715722b37 Apr 29 17:10:21 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:10:22 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root Apr 29 17:10:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-26a51330-e55c-4952-b296-61305707b2c1 tempest-VolumesAssistedSnapshotsTest-808181805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a159704f-5efb-4276-b248-dfd715722b37" returned: 0 in 0.664s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:10:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-26a51330-e55c-4952-b296-61305707b2c1 tempest-VolumesAssistedSnapshotsTest-808181805 None] Lock "cinder-quobyte-a159704f-5efb-4276-b248-dfd715722b37" released by "delete_volume" :: held 1.423s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:10:22 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-26a51330-e55c-4952-b296-61305707b2c1 tempest-VolumesAssistedSnapshotsTest-808181805 None] Created reservations ['a5431e1f-f184-4442-a243-7adb35f83319', '094e83df-aeb5-4672-b531-08ee0e7f8b12', '92e3ea1b-7f63-4521-8ff7-015980e45f3e', 'bc51fcce-8d3f-48ca-aeb4-e0a86b178651'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:10:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-26a51330-e55c-4952-b296-61305707b2c1 tempest-VolumesAssistedSnapshotsTest-808181805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:10:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-26a51330-e55c-4952-b296-61305707b2c1 tempest-VolumesAssistedSnapshotsTest-808181805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:10:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-26a51330-e55c-4952-b296-61305707b2c1 tempest-VolumesAssistedSnapshotsTest-808181805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:10:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-26a51330-e55c-4952-b296-61305707b2c1 tempest-VolumesAssistedSnapshotsTest-808181805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:10:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-26a51330-e55c-4952-b296-61305707b2c1 tempest-VolumesAssistedSnapshotsTest-808181805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:10:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-26a51330-e55c-4952-b296-61305707b2c1 tempest-VolumesAssistedSnapshotsTest-808181805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:10:22 devstack sudo[86391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:10:22 devstack sudo[86391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:10:23 devstack sudo[86391]: pam_unix(sudo:session): session closed for user root Apr 29 17:10:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-26a51330-e55c-4952-b296-61305707b2c1 tempest-VolumesAssistedSnapshotsTest-808181805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.987s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:10:23 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-26a51330-e55c-4952-b296-61305707b2c1 tempest-VolumesAssistedSnapshotsTest-808181805 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:10:23 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-26a51330-e55c-4952-b296-61305707b2c1 tempest-VolumesAssistedSnapshotsTest-808181805 None] Deleted volume successfully. Apr 29 17:10:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-26a51330-e55c-4952-b296-61305707b2c1 tempest-VolumesAssistedSnapshotsTest-808181805 None] Lock "cinder-a159704f-5efb-4276-b248-dfd715722b37-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:10:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-91c85e30-34a5-46fb-9944-4e1813f2847f tempest-DeleteServersTestJSON-106581627 None] Acquiring lock "cinder-1c564496-b66c-4ab7-a579-0c661993b15a-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:10:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-91c85e30-34a5-46fb-9944-4e1813f2847f tempest-DeleteServersTestJSON-106581627 None] Lock "cinder-1c564496-b66c-4ab7-a579-0c661993b15a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:10:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-91c85e30-34a5-46fb-9944-4e1813f2847f tempest-DeleteServersTestJSON-106581627 None] Acquiring lock "cinder-quobyte-1c564496-b66c-4ab7-a579-0c661993b15a" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:10:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-91c85e30-34a5-46fb-9944-4e1813f2847f tempest-DeleteServersTestJSON-106581627 None] Lock "cinder-quobyte-1c564496-b66c-4ab7-a579-0c661993b15a" acquired by "delete_volume" :: waited 0.036s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:10:26 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab682028-b9f1-4a89-a838-0255bbccad9e]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:10:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-91c85e30-34a5-46fb-9944-4e1813f2847f tempest-DeleteServersTestJSON-106581627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c564496-b66c-4ab7-a579-0c661993b15a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:10:27 devstack sudo[86454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c564496-b66c-4ab7-a579-0c661993b15a Apr 29 17:10:27 devstack sudo[86454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:10:27 devstack sudo[86454]: pam_unix(sudo:session): session closed for user root Apr 29 17:10:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-91c85e30-34a5-46fb-9944-4e1813f2847f tempest-DeleteServersTestJSON-106581627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c564496-b66c-4ab7-a579-0c661993b15a" returned: 0 in 0.822s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:10:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-91c85e30-34a5-46fb-9944-4e1813f2847f tempest-DeleteServersTestJSON-106581627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c564496-b66c-4ab7-a579-0c661993b15a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:10:27 devstack sudo[86460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c564496-b66c-4ab7-a579-0c661993b15a Apr 29 17:10:27 devstack sudo[86460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:10:28 devstack sudo[86460]: pam_unix(sudo:session): session closed for user root Apr 29 17:10:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-91c85e30-34a5-46fb-9944-4e1813f2847f tempest-DeleteServersTestJSON-106581627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c564496-b66c-4ab7-a579-0c661993b15a" returned: 0 in 0.634s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:10:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-91c85e30-34a5-46fb-9944-4e1813f2847f tempest-DeleteServersTestJSON-106581627 None] Lock "cinder-quobyte-1c564496-b66c-4ab7-a579-0c661993b15a" released by "delete_volume" :: held 1.517s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:10:28 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-91c85e30-34a5-46fb-9944-4e1813f2847f tempest-DeleteServersTestJSON-106581627 None] Created reservations ['6f0e7e97-7241-4d30-9a41-6c4835daee13', '9d046d9d-e17b-4885-9809-d2bd3b90db8f', '9268f06e-61e5-4679-b155-4486b51af2c5', '332da952-3e2e-4f9c-9f78-02c7ca2b4d7d'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:10:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-91c85e30-34a5-46fb-9944-4e1813f2847f tempest-DeleteServersTestJSON-106581627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:10:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-91c85e30-34a5-46fb-9944-4e1813f2847f tempest-DeleteServersTestJSON-106581627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:10:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-91c85e30-34a5-46fb-9944-4e1813f2847f tempest-DeleteServersTestJSON-106581627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:10:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-91c85e30-34a5-46fb-9944-4e1813f2847f tempest-DeleteServersTestJSON-106581627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:10:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-91c85e30-34a5-46fb-9944-4e1813f2847f tempest-DeleteServersTestJSON-106581627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:10:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-91c85e30-34a5-46fb-9944-4e1813f2847f tempest-DeleteServersTestJSON-106581627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:10:28 devstack sudo[86463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:10:28 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:10:29 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root Apr 29 17:10:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-91c85e30-34a5-46fb-9944-4e1813f2847f tempest-DeleteServersTestJSON-106581627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.777s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:10:29 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-91c85e30-34a5-46fb-9944-4e1813f2847f tempest-DeleteServersTestJSON-106581627 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:10:29 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-91c85e30-34a5-46fb-9944-4e1813f2847f tempest-DeleteServersTestJSON-106581627 None] Deleted volume successfully. Apr 29 17:10:29 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-91c85e30-34a5-46fb-9944-4e1813f2847f tempest-DeleteServersTestJSON-106581627 None] Lock "cinder-1c564496-b66c-4ab7-a579-0c661993b15a-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:10:38 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=31,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=1 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:10:39 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=27,cinder:INSERT=5,cinder:DELETE=2,cinder:SELECT=32 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:10:40 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4e4874ef-ad5b-4736-a257-89fc0c8c58ae tempest-TaggedAttachmentsTest-1683631342 None] Acquiring lock "cinder-3f631404-f54e-413f-91db-d7670497edde-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:10:40 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4e4874ef-ad5b-4736-a257-89fc0c8c58ae tempest-TaggedAttachmentsTest-1683631342 None] Lock "cinder-3f631404-f54e-413f-91db-d7670497edde-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:10:40 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4e4874ef-ad5b-4736-a257-89fc0c8c58ae tempest-TaggedAttachmentsTest-1683631342 None] Acquiring lock "cinder-quobyte-3f631404-f54e-413f-91db-d7670497edde" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:10:40 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4e4874ef-ad5b-4736-a257-89fc0c8c58ae tempest-TaggedAttachmentsTest-1683631342 None] Lock "cinder-quobyte-3f631404-f54e-413f-91db-d7670497edde" acquired by "delete_volume" :: waited 0.034s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:10:40 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e14ab25-6639-4e3d-b965-a06f373a42b1]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:10:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4e4874ef-ad5b-4736-a257-89fc0c8c58ae tempest-TaggedAttachmentsTest-1683631342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f631404-f54e-413f-91db-d7670497edde {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:10:40 devstack sudo[86605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f631404-f54e-413f-91db-d7670497edde Apr 29 17:10:40 devstack sudo[86605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:10:41 devstack sudo[86605]: pam_unix(sudo:session): session closed for user root Apr 29 17:10:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4e4874ef-ad5b-4736-a257-89fc0c8c58ae tempest-TaggedAttachmentsTest-1683631342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f631404-f54e-413f-91db-d7670497edde" returned: 0 in 1.046s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:10:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4e4874ef-ad5b-4736-a257-89fc0c8c58ae tempest-TaggedAttachmentsTest-1683631342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f631404-f54e-413f-91db-d7670497edde {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:10:41 devstack sudo[86611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f631404-f54e-413f-91db-d7670497edde Apr 29 17:10:41 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:10:42 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root Apr 29 17:10:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4e4874ef-ad5b-4736-a257-89fc0c8c58ae tempest-TaggedAttachmentsTest-1683631342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f631404-f54e-413f-91db-d7670497edde" returned: 0 in 0.976s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:10:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4e4874ef-ad5b-4736-a257-89fc0c8c58ae tempest-TaggedAttachmentsTest-1683631342 None] Lock "cinder-quobyte-3f631404-f54e-413f-91db-d7670497edde" released by "delete_volume" :: held 2.086s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:10:42 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-4e4874ef-ad5b-4736-a257-89fc0c8c58ae tempest-TaggedAttachmentsTest-1683631342 None] Created reservations ['5a48dba7-9ccd-405a-9a0f-c4a1991b5d81', '53719eac-edb8-44bf-8978-f0b8352e6824', 'fa082ee1-c1f9-4ad2-a7fe-c71461cc5097', '108d100b-3c8b-4c70-938d-1ad13e5a1a4c'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:10:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4e4874ef-ad5b-4736-a257-89fc0c8c58ae tempest-TaggedAttachmentsTest-1683631342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:10:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4e4874ef-ad5b-4736-a257-89fc0c8c58ae tempest-TaggedAttachmentsTest-1683631342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:10:42 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4e4874ef-ad5b-4736-a257-89fc0c8c58ae tempest-TaggedAttachmentsTest-1683631342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:10:42 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4e4874ef-ad5b-4736-a257-89fc0c8c58ae tempest-TaggedAttachmentsTest-1683631342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:10:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4e4874ef-ad5b-4736-a257-89fc0c8c58ae tempest-TaggedAttachmentsTest-1683631342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:10:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4e4874ef-ad5b-4736-a257-89fc0c8c58ae tempest-TaggedAttachmentsTest-1683631342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:10:42 devstack sudo[86615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:10:42 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:10:43 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root Apr 29 17:10:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4e4874ef-ad5b-4736-a257-89fc0c8c58ae tempest-TaggedAttachmentsTest-1683631342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.686s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:10:43 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-4e4874ef-ad5b-4736-a257-89fc0c8c58ae tempest-TaggedAttachmentsTest-1683631342 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:10:43 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4e4874ef-ad5b-4736-a257-89fc0c8c58ae tempest-TaggedAttachmentsTest-1683631342 None] Deleted volume successfully. Apr 29 17:10:43 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4e4874ef-ad5b-4736-a257-89fc0c8c58ae tempest-TaggedAttachmentsTest-1683631342 None] Lock "cinder-3f631404-f54e-413f-91db-d7670497edde-delete_volume" released by "delete_volume" :: held 3.126s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:10:52 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=10,cinder:SELECT=4,cinder:INSERT=1 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:10:53 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Flow 'volume_create_manager' (d5281c71-89f7-44b2-aefc-94de6d06a17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7234c0d-8349-4770-becd-18153e984a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7234c0d-8349-4770-becd-18153e984a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherB-volume-2042781559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5f91a5-4954-4661-a5bc-d8e586e98a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56294f468bed418d9c444948ed95a725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:11:02Z,use_quota=True,user_id='e663d86f115e491c9fc33cfd60df1a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d6e305-3534-48b5-830d-75839a201c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d6e305-3534-48b5-830d-75839a201c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169d3562-49db-4827-a00c-065f3cfa51b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (169d3562-49db-4827-a00c-065f3cfa51b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d5f91a5-4954-4661-a5bc-d8e586e98a05', 'volume_name': 'volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15909493-a69e-404a-a083-11905e1ee33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15909493-a69e-404a-a083-11905e1ee33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c81078a-3091-40dc-8863-00345dc41a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:01 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Volume 5d5f91a5-4954-4661-a5bc-d8e586e98a05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05', 'volume_size': 1} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherB-volume-2042781559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5f91a5-4954-4661-a5bc-d8e586e98a05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56294f468bed418d9c444948ed95a725',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:11:02Z,use_quota=True,user_id='e663d86f115e491c9fc33cfd60df1a33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Creating volume 5d5f91a5-4954-4661-a5bc-d8e586e98a05 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:11:01 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:11:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:01 devstack sudo[86693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05 1073741824 Apr 29 17:11:01 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:03 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05 1073741824" returned: 0 in 1.101s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:03 devstack sudo[86702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05 Apr 29 17:11:03 devstack sudo[86702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:03 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:11:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Flow 'volume_create_manager' (bc420a2d-3aa0-48d9-a202-ce312d135847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:11:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997b6020-3b0e-4363-9d01-3e7656b8cc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997b6020-3b0e-4363-9d01-3e7656b8cc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-175318811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc050001-054a-4e6d-ae2e-4954ebd03ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20413c38408d4c7f8c90b0a8f26d00b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:11:04Z,use_quota=True,user_id='88cdd9cc63da4f7681c4ba5c67f2c98c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c91ff1-b2a8-421c-9998-3a101301dd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c91ff1-b2a8-421c-9998-3a101301dd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e815701-6d5d-4736-a20c-41ffe3157587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:03 devstack cinder-volume[84547]: DEBUG cinder.image.glance [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Creating Keystone auth plugin from conf {{(pid=84547) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 17:11:04 devstack sudo[86702]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05" returned: 0 in 0.925s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:04 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:11:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.094s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:11:04 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c81078a-3091-40dc-8863-00345dc41a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:04 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e2468e-28ab-4ee9-bc01-3f50f3131c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:04 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Volume volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05 (5d5f91a5-4954-4661-a5bc-d8e586e98a05): created successfully Apr 29 17:11:04 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9e2468e-28ab-4ee9-bc01-3f50f3131c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:04 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Flow 'volume_create_manager' (d5281c71-89f7-44b2-aefc-94de6d06a17d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:11:04 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-97f8aea3-4936-4811-bfcb-0bd00ff5edbf tempest-ServerActionsTestOtherB-1340184396 None] Created volume successfully. Apr 29 17:11:04 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e815701-6d5d-4736-a20c-41ffe3157587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cc050001-054a-4e6d-ae2e-4954ebd03ea2', 'volume_name': 'volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:04 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f33fb3b4-d913-4414-ab7e-961ac7e17096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:04 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f33fb3b4-d913-4414-ab7e-961ac7e17096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:04 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc1601d-e74c-4cbc-9e6a-c31dc31b51bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:04 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Volume cc050001-054a-4e6d-ae2e-4954ebd03ea2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 17:11:04 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Trying to clone cc050001-054a-4e6d-ae2e-4954ebd03ea2 from image 982d68c3-05b9-445d-85e5-5c92642a92aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]). {{(pid=84547) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 17:11:05 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_nsn3l5qwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 17:11:05 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Image download 20.69 MB at 20.69 MB/s Apr 29 17:11:05 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a4a72b-dee0-489b-8d2a-034a27f8822d]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:11:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_nsn3l5qwdevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:05 devstack sudo[86732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_nsn3l5qwdevstack@QuobyteHD Apr 29 17:11:05 devstack sudo[86732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:11:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:11:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:11:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:11:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:11:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:11:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:05 devstack sudo[86736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:11:05 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:06 devstack sudo[86732]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_nsn3l5qwdevstack@QuobyteHD" returned: 0 in 0.945s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:06 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Temporary image 982d68c3-05b9-445d-85e5-5c92642a92aa is fetched for user 88cdd9cc63da4f7681c4ba5c67f2c98c. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 17:11:06 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9763c27-5997-43fd-baf4-e6c4f52d6628]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:11:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_nsn3l5qwdevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:06 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.826s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:11:06 devstack sudo[86743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_nsn3l5qwdevstack@QuobyteHD Apr 29 17:11:06 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:07 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_nsn3l5qwdevstack@QuobyteHD" returned: 0 in 0.814s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:11:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:11:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-175318811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc050001-054a-4e6d-ae2e-4954ebd03ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20413c38408d4c7f8c90b0a8f26d00b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:11:04Z,use_quota=True,user_id='88cdd9cc63da4f7681c4ba5c67f2c98c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:11:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Creating volume cc050001-054a-4e6d-ae2e-4954ebd03ea2 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:11:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:11:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:11:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:11:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:11:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:11:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:11:07 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:11:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:07 devstack sudo[86748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 1073741824 Apr 29 17:11:07 devstack sudo[86748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:08 devstack sudo[86748]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 1073741824" returned: 0 in 0.917s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:08 devstack sudo[86754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 Apr 29 17:11:08 devstack sudo[86754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:08 devstack sudo[86754]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2" returned: 0 in 0.653s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:11:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:11:08 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Attempting download of 982d68c3-05b9-445d-85e5-5c92642a92aa ((None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}])) to volume cc050001-054a-4e6d-ae2e-4954ebd03ea2. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 17:11:08 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b6958c-8d52-420a-b0c1-ce35e21aa715]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:11:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_57icj3lh {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:09 devstack sudo[86757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_57icj3lh Apr 29 17:11:09 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:09 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_57icj3lh" returned: 0 in 1.014s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_57icj3lh {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:10 devstack sudo[86761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_57icj3lh Apr 29 17:11:10 devstack sudo[86761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-de6e2a3f-f725-4138-be16-476d1eb90a4f req-b0decd8c-7155-4c36-adb1-0f5a534d5960 tempest-ServerActionsTestOtherB-1340184396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:11:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-de6e2a3f-f725-4138-be16-476d1eb90a4f req-b0decd8c-7155-4c36-adb1-0f5a534d5960 tempest-ServerActionsTestOtherB-1340184396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:11:10 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4d657a-02b8-4ff9-ae6f-b2995c93449c]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:11:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-de6e2a3f-f725-4138-be16-476d1eb90a4f req-b0decd8c-7155-4c36-adb1-0f5a534d5960 tempest-ServerActionsTestOtherB-1340184396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:10 devstack sudo[86761]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_57icj3lh" returned: 1 in 0.910s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_57icj3lh' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:11:10 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[1481916d-5b0c-44ff-82f7-b1d1159073b0]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:11:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_nsn3l5qwdevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:10 devstack sudo[86771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05 Apr 29 17:11:10 devstack sudo[86771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:10 devstack sudo[86774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_nsn3l5qwdevstack@QuobyteHD Apr 29 17:11:10 devstack sudo[86774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:11 devstack sudo[86771]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-de6e2a3f-f725-4138-be16-476d1eb90a4f req-b0decd8c-7155-4c36-adb1-0f5a534d5960 tempest-ServerActionsTestOtherB-1340184396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05" returned: 0 in 0.950s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-de6e2a3f-f725-4138-be16-476d1eb90a4f req-b0decd8c-7155-4c36-adb1-0f5a534d5960 tempest-ServerActionsTestOtherB-1340184396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.981s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:11:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-de6e2a3f-f725-4138-be16-476d1eb90a4f req-b0decd8c-7155-4c36-adb1-0f5a534d5960 tempest-ServerActionsTestOtherB-1340184396 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e6c9d59-227a-48d5-84f7-f0c7b764fe40', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:11:11 devstack sudo[86774]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_nsn3l5qwdevstack@QuobyteHD" returned: 0 in 0.877s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:11 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] 982d68c3-05b9-445d-85e5-5c92642a92aa was qcow2, converting to raw {{(pid=84547) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 17:11:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_nsn3l5qwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:11 devstack sudo[86784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_nsn3l5qwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 Apr 29 17:11:11 devstack sudo[86784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:11 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-de6e2a3f-f725-4138-be16-476d1eb90a4f req-b0decd8c-7155-4c36-adb1-0f5a534d5960 tempest-ServerActionsTestOtherB-1340184396 None] attachment_update completed successfully. Apr 29 17:11:14 devstack sudo[86784]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_nsn3l5qwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2" returned: 0 in 2.725s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:14 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_nsn3l5qwdevstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:11:14 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Converted 112.00 MB image at 41.08 MB/s Apr 29 17:11:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:14 devstack sudo[87173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 1G Apr 29 17:11:14 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:15 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 1G" returned: 0 in 0.943s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:15 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[6909ab07-03c8-44ec-900a-b1ff7696977b]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:11:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:15 devstack sudo[87179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 Apr 29 17:11:15 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:16 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2" returned: 0 in 0.881s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:16 devstack sudo[87183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 Apr 29 17:11:16 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:17 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2" returned: 1 in 1.023s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:11:17 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Downloaded image 982d68c3-05b9-445d-85e5-5c92642a92aa ((None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}])) to volume cc050001-054a-4e6d-ae2e-4954ebd03ea2 successfully. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 17:11:17 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Temporary image 982d68c3-05b9-445d-85e5-5c92642a92aa for user 88cdd9cc63da4f7681c4ba5c67f2c98c is deleted. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 17:11:17 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Marking volume cc050001-054a-4e6d-ae2e-4954ebd03ea2 as bootable. {{(pid=84547) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 17:11:17 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Copying metadata from image 982d68c3-05b9-445d-85e5-5c92642a92aa to cc050001-054a-4e6d-ae2e-4954ebd03ea2. {{(pid=84547) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 17:11:17 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Creating volume glance metadata for volume cc050001-054a-4e6d-ae2e-4954ebd03ea2 backed by image 982d68c3-05b9-445d-85e5-5c92642a92aa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84547) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 17:11:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc1601d-e74c-4cbc-9e6a-c31dc31b51bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e21ad6-6ba8-4c1e-a1d0-09e651aa7435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:17 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Volume volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 (cc050001-054a-4e6d-ae2e-4954ebd03ea2): created successfully Apr 29 17:11:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e21ad6-6ba8-4c1e-a1d0-09e651aa7435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Flow 'volume_create_manager' (bc420a2d-3aa0-48d9-a202-ce312d135847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:11:17 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-5896d8c3-aedf-4cde-9d41-57322b590394 tempest-TaggedBootDevicesTest_v242-2032052281 None] Created volume successfully. Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Flow 'volume_create_manager' (b8848d09-d744-4658-9248-bbc6626e4b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1493e90-35b3-4417-9d42-80647d198c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1493e90-35b3-4417-9d42-80647d198c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1529970660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c53aca0-1e9b-4bbe-babc-6ce4761de67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20413c38408d4c7f8c90b0a8f26d00b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:11:19Z,use_quota=True,user_id='88cdd9cc63da4f7681c4ba5c67f2c98c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9adbbe68-5514-4a1a-8f5b-f8edba9ee375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9adbbe68-5514-4a1a-8f5b-f8edba9ee375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f859aa42-9f1f-4bda-8f6e-cde2b673a635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f859aa42-9f1f-4bda-8f6e-cde2b673a635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c53aca0-1e9b-4bbe-babc-6ce4761de67d', 'volume_name': 'volume-2c53aca0-1e9b-4bbe-babc-6ce4761de67d', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029d9ed0-6bf9-48fa-ae34-04606e6fa45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029d9ed0-6bf9-48fa-ae34-04606e6fa45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80f6481-77e3-4359-84bb-a254c9971070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:18 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Volume 2c53aca0-1e9b-4bbe-babc-6ce4761de67d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c53aca0-1e9b-4bbe-babc-6ce4761de67d', 'volume_size': 1} Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1529970660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c53aca0-1e9b-4bbe-babc-6ce4761de67d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20413c38408d4c7f8c90b0a8f26d00b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:11:19Z,use_quota=True,user_id='88cdd9cc63da4f7681c4ba5c67f2c98c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Creating volume 2c53aca0-1e9b-4bbe-babc-6ce4761de67d {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:11:18 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:11:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c53aca0-1e9b-4bbe-babc-6ce4761de67d 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:18 devstack sudo[87188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c53aca0-1e9b-4bbe-babc-6ce4761de67d 1073741824 Apr 29 17:11:18 devstack sudo[87188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:19 devstack sudo[87188]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c53aca0-1e9b-4bbe-babc-6ce4761de67d 1073741824" returned: 0 in 0.871s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c53aca0-1e9b-4bbe-babc-6ce4761de67d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:19 devstack sudo[87194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c53aca0-1e9b-4bbe-babc-6ce4761de67d Apr 29 17:11:19 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:20 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c53aca0-1e9b-4bbe-babc-6ce4761de67d" returned: 0 in 0.821s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:20 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:11:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:11:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d80f6481-77e3-4359-84bb-a254c9971070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c53aca0-1e9b-4bbe-babc-6ce4761de67d', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f843cd7f-42c8-435d-b54a-df3c9edac8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:20 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Volume volume-2c53aca0-1e9b-4bbe-babc-6ce4761de67d (2c53aca0-1e9b-4bbe-babc-6ce4761de67d): created successfully Apr 29 17:11:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f843cd7f-42c8-435d-b54a-df3c9edac8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Flow 'volume_create_manager' (b8848d09-d744-4658-9248-bbc6626e4b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:11:20 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-aaef9f37-44e5-4c00-96da-4a2dcf8b7d04 tempest-TaggedBootDevicesTest_v242-2032052281 None] Created volume successfully. Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Flow 'volume_create_manager' (1ba6d1e0-9a19-4167-9f6f-3bf6dd376e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0231317-cecb-4f64-b3ac-9f75019768c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0231317-cecb-4f64-b3ac-9f75019768c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-783926006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2610c0-4b4e-42c3-956d-dd4df4118d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20413c38408d4c7f8c90b0a8f26d00b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:11:21Z,use_quota=True,user_id='88cdd9cc63da4f7681c4ba5c67f2c98c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85422b5-ded9-4551-af1f-498c69be6d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85422b5-ded9-4551-af1f-498c69be6d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (934be5d0-1ef2-46d9-990c-e3a48eb590c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (934be5d0-1ef2-46d9-990c-e3a48eb590c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc2610c0-4b4e-42c3-956d-dd4df4118d1c', 'volume_name': 'volume-cc2610c0-4b4e-42c3-956d-dd4df4118d1c', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7cbbd2-2c08-4689-83ad-708f5d362f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7cbbd2-2c08-4689-83ad-708f5d362f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac44d62-71f4-4d48-84b4-f3114580c9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:21 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Volume cc2610c0-4b4e-42c3-956d-dd4df4118d1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc2610c0-4b4e-42c3-956d-dd4df4118d1c', 'volume_size': 1} Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-783926006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2610c0-4b4e-42c3-956d-dd4df4118d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20413c38408d4c7f8c90b0a8f26d00b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:11:21Z,use_quota=True,user_id='88cdd9cc63da4f7681c4ba5c67f2c98c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Creating volume cc2610c0-4b4e-42c3-956d-dd4df4118d1c {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:11:21 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:11:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc2610c0-4b4e-42c3-956d-dd4df4118d1c 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:21 devstack sudo[87199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc2610c0-4b4e-42c3-956d-dd4df4118d1c 1073741824 Apr 29 17:11:21 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:22 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc2610c0-4b4e-42c3-956d-dd4df4118d1c 1073741824" returned: 0 in 0.951s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc2610c0-4b4e-42c3-956d-dd4df4118d1c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:22 devstack sudo[87206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc2610c0-4b4e-42c3-956d-dd4df4118d1c Apr 29 17:11:22 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:23 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc2610c0-4b4e-42c3-956d-dd4df4118d1c" returned: 0 in 0.730s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:23 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:11:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:11:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac44d62-71f4-4d48-84b4-f3114580c9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc2610c0-4b4e-42c3-956d-dd4df4118d1c', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782c03cf-623c-4e04-9283-2578c6d79696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:23 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Volume volume-cc2610c0-4b4e-42c3-956d-dd4df4118d1c (cc2610c0-4b4e-42c3-956d-dd4df4118d1c): created successfully Apr 29 17:11:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782c03cf-623c-4e04-9283-2578c6d79696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Flow 'volume_create_manager' (1ba6d1e0-9a19-4167-9f6f-3bf6dd376e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:11:23 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-c82035f8-3815-4200-a18b-e86b804ca518 tempest-TaggedBootDevicesTest_v242-2032052281 None] Created volume successfully. Apr 29 17:11:33 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=19,cinder:SELECT=25,cinder:INSERT=7,cinder:DELETE=1 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:11:33 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=17,cinder:UPDATE=11,cinder:INSERT=10,cinder:DELETE=3 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:11:36 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:11:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Flow 'volume_create_manager' (9d3f0703-76bc-4f24-9665-5828a445c54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:11:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c123c40-a390-4761-a402-4c23b768dd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c123c40-a390-4761-a402-4c23b768dd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1561909841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8edc886b-6920-4dcf-ae8c-dfa2ec00dffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dabcd6e0a25a4855bcf33b28ca5a1cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:11:36Z,use_quota=True,user_id='e1f3ff6ee3d14b3d883da05b87ac7056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be042bfe-67a9-49ef-8a5f-69ec08a23628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be042bfe-67a9-49ef-8a5f-69ec08a23628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b744314-c814-4706-a29f-d8b96443aab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:36 devstack cinder-volume[84547]: DEBUG cinder.image.glance [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Creating Keystone auth plugin from conf {{(pid=84547) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 17:11:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b744314-c814-4706-a29f-d8b96443aab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8edc886b-6920-4dcf-ae8c-dfa2ec00dffb', 'volume_name': 'volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d81f24-9aa4-443c-bd74-e7b8f47092e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41d81f24-9aa4-443c-bd74-e7b8f47092e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a47fb8-1d70-41c1-96e6-4f251cc37273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:36 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Volume 8edc886b-6920-4dcf-ae8c-dfa2ec00dffb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 17:11:36 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Trying to clone 8edc886b-6920-4dcf-ae8c-dfa2ec00dffb from image 982d68c3-05b9-445d-85e5-5c92642a92aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]). {{(pid=84547) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 17:11:37 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ge18ptatdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 17:11:37 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Image download 20.69 MB at 20.69 MB/s Apr 29 17:11:37 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b45656-5c4d-4e10-9f30-b432f67a31be]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:11:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ge18ptatdevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:37 devstack sudo[87240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ge18ptatdevstack@QuobyteHD Apr 29 17:11:37 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:38 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ge18ptatdevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:38 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Temporary image 982d68c3-05b9-445d-85e5-5c92642a92aa is fetched for user e1f3ff6ee3d14b3d883da05b87ac7056. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 17:11:38 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ad81cb-9886-4cef-85fd-06ae6baf2eeb]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:11:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ge18ptatdevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:38 devstack sudo[87256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ge18ptatdevstack@QuobyteHD Apr 29 17:11:38 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:39 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ge18ptatdevstack@QuobyteHD" returned: 0 in 1.144s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:11:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:11:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1561909841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8edc886b-6920-4dcf-ae8c-dfa2ec00dffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dabcd6e0a25a4855bcf33b28ca5a1cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:11:36Z,use_quota=True,user_id='e1f3ff6ee3d14b3d883da05b87ac7056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:11:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Creating volume 8edc886b-6920-4dcf-ae8c-dfa2ec00dffb {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:11:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:11:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:11:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:11:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:11:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:11:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:11:39 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:11:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:39 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb 1073741824 Apr 29 17:11:39 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:39 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-1c04de5a-9532-4818-95df-a7bb8f5c4266 req-69af560c-f959-42ee-994c-cced173999b8 tempest-ServerActionsTestOtherB-1340184396 None] Terminate volume connection completed successfully. Apr 29 17:11:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-1c04de5a-9532-4818-95df-a7bb8f5c4266 req-69af560c-f959-42ee-994c-cced173999b8 tempest-ServerActionsTestOtherB-1340184396 None] Deleting attachment 7e6c9d59-227a-48d5-84f7-f0c7b764fe40. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:11:40 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb 1073741824" returned: 0 in 1.172s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:40 devstack sudo[87344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb Apr 29 17:11:40 devstack sudo[87344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:41 devstack sudo[87344]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb" returned: 0 in 0.806s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:41 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:11:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:11:41 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Attempting download of 982d68c3-05b9-445d-85e5-5c92642a92aa ((None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}])) to volume 8edc886b-6920-4dcf-ae8c-dfa2ec00dffb. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 17:11:41 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[560aeef5-88f0-42dd-8858-44d3504ac45c]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:11:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_q2jwkj6q {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:41 devstack sudo[87349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_q2jwkj6q Apr 29 17:11:41 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:42 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_q2jwkj6q" returned: 0 in 0.855s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_q2jwkj6q {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:42 devstack sudo[87354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_q2jwkj6q Apr 29 17:11:42 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:43 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_q2jwkj6q" returned: 1 in 0.817s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_q2jwkj6q' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:11:43 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b015a72-cc04-4c1f-8492-d8449530d697]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:11:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ge18ptatdevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:43 devstack sudo[87363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ge18ptatdevstack@QuobyteHD Apr 29 17:11:43 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:44 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ge18ptatdevstack@QuobyteHD" returned: 0 in 0.721s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:44 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] 982d68c3-05b9-445d-85e5-5c92642a92aa was qcow2, converting to raw {{(pid=84547) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 17:11:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ge18ptatdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:44 devstack sudo[87368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ge18ptatdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb Apr 29 17:11:44 devstack sudo[87368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-1c04de5a-9532-4818-95df-a7bb8f5c4266 req-e46fa50e-4284-45f9-aac0-db2b49da9b23 tempest-ServerActionsTestOtherB-1340184396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:11:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-1c04de5a-9532-4818-95df-a7bb8f5c4266 req-e46fa50e-4284-45f9-aac0-db2b49da9b23 tempest-ServerActionsTestOtherB-1340184396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:11:45 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2b195d-848c-446e-a0ea-416f41e199e8]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:11:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-1c04de5a-9532-4818-95df-a7bb8f5c4266 req-e46fa50e-4284-45f9-aac0-db2b49da9b23 tempest-ServerActionsTestOtherB-1340184396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:46 devstack sudo[87411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05 Apr 29 17:11:46 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:46 devstack sudo[87368]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ge18ptatdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb" returned: 0 in 2.413s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:46 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ge18ptatdevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:11:46 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Converted 112.00 MB image at 46.39 MB/s Apr 29 17:11:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:46 devstack sudo[87435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb 1G Apr 29 17:11:46 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:47 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-1c04de5a-9532-4818-95df-a7bb8f5c4266 req-e46fa50e-4284-45f9-aac0-db2b49da9b23 tempest-ServerActionsTestOtherB-1340184396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05" returned: 0 in 1.131s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-1c04de5a-9532-4818-95df-a7bb8f5c4266 req-e46fa50e-4284-45f9-aac0-db2b49da9b23 tempest-ServerActionsTestOtherB-1340184396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.161s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:11:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-1c04de5a-9532-4818-95df-a7bb8f5c4266 req-e46fa50e-4284-45f9-aac0-db2b49da9b23 tempest-ServerActionsTestOtherB-1340184396 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba00fbf6-8c8f-4302-9bcc-82eaffce0f24', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:11:47 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-1c04de5a-9532-4818-95df-a7bb8f5c4266 req-e46fa50e-4284-45f9-aac0-db2b49da9b23 tempest-ServerActionsTestOtherB-1340184396 None] attachment_update completed successfully. Apr 29 17:11:47 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb 1G" returned: 0 in 0.898s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:47 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a845dc-db5c-47bd-a4ab-fddafb87e29c]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:11:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:47 devstack sudo[87446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb Apr 29 17:11:47 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:48 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb" returned: 0 in 0.813s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:48 devstack sudo[87454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb Apr 29 17:11:48 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:49 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb" returned: 1 in 0.855s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:11:49 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Downloaded image 982d68c3-05b9-445d-85e5-5c92642a92aa ((None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}])) to volume 8edc886b-6920-4dcf-ae8c-dfa2ec00dffb successfully. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 17:11:49 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Temporary image 982d68c3-05b9-445d-85e5-5c92642a92aa for user e1f3ff6ee3d14b3d883da05b87ac7056 is deleted. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 17:11:49 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Marking volume 8edc886b-6920-4dcf-ae8c-dfa2ec00dffb as bootable. {{(pid=84547) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 17:11:49 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Copying metadata from image 982d68c3-05b9-445d-85e5-5c92642a92aa to 8edc886b-6920-4dcf-ae8c-dfa2ec00dffb. {{(pid=84547) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 17:11:49 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Creating volume glance metadata for volume 8edc886b-6920-4dcf-ae8c-dfa2ec00dffb backed by image 982d68c3-05b9-445d-85e5-5c92642a92aa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84547) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 17:11:49 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81a47fb8-1d70-41c1-96e6-4f251cc37273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:49 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c678064-0263-43a0-b151-bca9049f1a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:49 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Volume volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb (8edc886b-6920-4dcf-ae8c-dfa2ec00dffb): created successfully Apr 29 17:11:49 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c678064-0263-43a0-b151-bca9049f1a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:49 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Flow 'volume_create_manager' (9d3f0703-76bc-4f24-9665-5828a445c54f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:11:49 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-1fcc2dcb-adf3-40b7-b24f-82bb945cb617 tempest-TaggedBootDevicesTest-1271091301 None] Created volume successfully. Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Flow 'volume_create_manager' (28cc037b-041e-4e16-bba6-c3581dc780db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f6437d-a174-49df-84ff-e1d18b9503fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f6437d-a174-49df-84ff-e1d18b9503fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-173763854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba75bdc-8c93-41b9-a965-a73db0e30ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dabcd6e0a25a4855bcf33b28ca5a1cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:11:50Z,use_quota=True,user_id='e1f3ff6ee3d14b3d883da05b87ac7056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102cf422-ef0b-4367-87d1-680485f54a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102cf422-ef0b-4367-87d1-680485f54a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8ed1da-f456-4c18-abeb-4d084e611661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8ed1da-f456-4c18-abeb-4d084e611661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ba75bdc-8c93-41b9-a965-a73db0e30ecb', 'volume_name': 'volume-8ba75bdc-8c93-41b9-a965-a73db0e30ecb', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f83348-4c74-464e-898a-204bc7af2767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f83348-4c74-464e-898a-204bc7af2767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57753d3e-71a5-4ce1-96f6-68765b348e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:50 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Volume 8ba75bdc-8c93-41b9-a965-a73db0e30ecb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ba75bdc-8c93-41b9-a965-a73db0e30ecb', 'volume_size': 1} Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-173763854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba75bdc-8c93-41b9-a965-a73db0e30ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dabcd6e0a25a4855bcf33b28ca5a1cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:11:50Z,use_quota=True,user_id='e1f3ff6ee3d14b3d883da05b87ac7056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Creating volume 8ba75bdc-8c93-41b9-a965-a73db0e30ecb {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:11:50 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:11:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8ba75bdc-8c93-41b9-a965-a73db0e30ecb 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:50 devstack sudo[87531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8ba75bdc-8c93-41b9-a965-a73db0e30ecb 1073741824 Apr 29 17:11:50 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:52 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8ba75bdc-8c93-41b9-a965-a73db0e30ecb 1073741824" returned: 0 in 1.523s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8ba75bdc-8c93-41b9-a965-a73db0e30ecb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:52 devstack sudo[87931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8ba75bdc-8c93-41b9-a965-a73db0e30ecb Apr 29 17:11:52 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:53 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8ba75bdc-8c93-41b9-a965-a73db0e30ecb" returned: 0 in 1.060s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] <== create_volume: return (2677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:11:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.681s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:11:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57753d3e-71a5-4ce1-96f6-68765b348e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ba75bdc-8c93-41b9-a965-a73db0e30ecb', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0138b9-ee34-4c79-b83d-b86eba44aedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:53 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Volume volume-8ba75bdc-8c93-41b9-a965-a73db0e30ecb (8ba75bdc-8c93-41b9-a965-a73db0e30ecb): created successfully Apr 29 17:11:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0138b9-ee34-4c79-b83d-b86eba44aedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Flow 'volume_create_manager' (28cc037b-041e-4e16-bba6-c3581dc780db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:11:53 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-1bcfadba-b4d0-4751-97d6-52d69c306703 tempest-TaggedBootDevicesTest-1271091301 None] Created volume successfully. Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Flow 'volume_create_manager' (da6725e7-3fa9-4a84-a496-7de405f6e3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3505ca-ef8f-4ad0-bcc0-99b6cf085999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3505ca-ef8f-4ad0-bcc0-99b6cf085999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-609126062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a08afc-782f-44d0-875b-9f0bb7f55ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dabcd6e0a25a4855bcf33b28ca5a1cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:11:54Z,use_quota=True,user_id='e1f3ff6ee3d14b3d883da05b87ac7056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d15db34-1978-4007-a3b3-dad04b6468ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d15db34-1978-4007-a3b3-dad04b6468ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3a20c6-2f8c-4d9e-aab4-56e975b1557e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3a20c6-2f8c-4d9e-aab4-56e975b1557e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a08afc-782f-44d0-875b-9f0bb7f55ee2', 'volume_name': 'volume-c0a08afc-782f-44d0-875b-9f0bb7f55ee2', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1116c409-8321-45f9-b4f3-5147f8fbef38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1116c409-8321-45f9-b4f3-5147f8fbef38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f6b136-9989-4e51-93f1-8a879cac34d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:54 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Volume c0a08afc-782f-44d0-875b-9f0bb7f55ee2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a08afc-782f-44d0-875b-9f0bb7f55ee2', 'volume_size': 1} Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-609126062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a08afc-782f-44d0-875b-9f0bb7f55ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dabcd6e0a25a4855bcf33b28ca5a1cdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:11:54Z,use_quota=True,user_id='e1f3ff6ee3d14b3d883da05b87ac7056',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Creating volume c0a08afc-782f-44d0-875b-9f0bb7f55ee2 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:11:54 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:11:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0a08afc-782f-44d0-875b-9f0bb7f55ee2 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:54 devstack sudo[87955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0a08afc-782f-44d0-875b-9f0bb7f55ee2 1073741824 Apr 29 17:11:54 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:56 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0a08afc-782f-44d0-875b-9f0bb7f55ee2 1073741824" returned: 0 in 1.812s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0a08afc-782f-44d0-875b-9f0bb7f55ee2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:56 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0a08afc-782f-44d0-875b-9f0bb7f55ee2 Apr 29 17:11:56 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:57 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0a08afc-782f-44d0-875b-9f0bb7f55ee2" returned: 0 in 1.007s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:57 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] <== create_volume: return (2896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:11:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.899s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:11:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8f6b136-9989-4e51-93f1-8a879cac34d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a08afc-782f-44d0-875b-9f0bb7f55ee2', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f76f863-4041-40cc-80e7-42d306bcd1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:11:57 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Volume volume-c0a08afc-782f-44d0-875b-9f0bb7f55ee2 (c0a08afc-782f-44d0-875b-9f0bb7f55ee2): created successfully Apr 29 17:11:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f76f863-4041-40cc-80e7-42d306bcd1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:11:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Flow 'volume_create_manager' (da6725e7-3fa9-4a84-a496-7de405f6e3dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:11:57 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-7562ae6e-d0f1-4efa-85d7-49ef95d20e9b tempest-TaggedBootDevicesTest-1271091301 None] Created volume successfully. Apr 29 17:11:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-237cfcd5-d0fd-47d8-9725-327844285116 req-f419be11-a937-46e8-bcc8-91b8e5ce5ab1 tempest-TaggedBootDevicesTest_v242-2032052281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:11:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-237cfcd5-d0fd-47d8-9725-327844285116 req-f419be11-a937-46e8-bcc8-91b8e5ce5ab1 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:11:57 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57b8fea-dbf9-42d9-a1b4-168a987916dc]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:11:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-237cfcd5-d0fd-47d8-9725-327844285116 req-f419be11-a937-46e8-bcc8-91b8e5ce5ab1 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:57 devstack sudo[87978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 Apr 29 17:11:57 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:11:58 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root Apr 29 17:11:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-237cfcd5-d0fd-47d8-9725-327844285116 req-f419be11-a937-46e8-bcc8-91b8e5ce5ab1 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2" returned: 0 in 1.163s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:11:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-237cfcd5-d0fd-47d8-9725-327844285116 req-f419be11-a937-46e8-bcc8-91b8e5ce5ab1 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:11:58 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 Apr 29 17:11:58 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:12:00 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Apr 29 17:12:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-237cfcd5-d0fd-47d8-9725-327844285116 req-f419be11-a937-46e8-bcc8-91b8e5ce5ab1 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2" returned: 1 in 1.785s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:12:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-237cfcd5-d0fd-47d8-9725-327844285116 req-f419be11-a937-46e8-bcc8-91b8e5ce5ab1 tempest-TaggedBootDevicesTest_v242-2032052281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:12:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-237cfcd5-d0fd-47d8-9725-327844285116 req-f419be11-a937-46e8-bcc8-91b8e5ce5ab1 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.026s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:12:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-237cfcd5-d0fd-47d8-9725-327844285116 req-f419be11-a937-46e8-bcc8-91b8e5ce5ab1 tempest-TaggedBootDevicesTest_v242-2032052281 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '50023377-0132-4819-bc0f-5c1e1aa4c273', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:12:00 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-237cfcd5-d0fd-47d8-9725-327844285116 req-f419be11-a937-46e8-bcc8-91b8e5ce5ab1 tempest-TaggedBootDevicesTest_v242-2032052281 None] attachment_update completed successfully. Apr 29 17:12:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-237cfcd5-d0fd-47d8-9725-327844285116 req-49cb100f-10be-4481-b03c-c81508150620 tempest-TaggedBootDevicesTest_v242-2032052281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:12:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-237cfcd5-d0fd-47d8-9725-327844285116 req-49cb100f-10be-4481-b03c-c81508150620 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:12:02 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2360116-d4ec-4ab2-8c21-4040dfb5a3a6]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:12:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-237cfcd5-d0fd-47d8-9725-327844285116 req-49cb100f-10be-4481-b03c-c81508150620 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c53aca0-1e9b-4bbe-babc-6ce4761de67d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:12:03 devstack sudo[88063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c53aca0-1e9b-4bbe-babc-6ce4761de67d Apr 29 17:12:03 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:12:04 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root Apr 29 17:12:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-237cfcd5-d0fd-47d8-9725-327844285116 req-49cb100f-10be-4481-b03c-c81508150620 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c53aca0-1e9b-4bbe-babc-6ce4761de67d" returned: 0 in 1.550s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:12:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-237cfcd5-d0fd-47d8-9725-327844285116 req-49cb100f-10be-4481-b03c-c81508150620 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.580s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:12:04 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-237cfcd5-d0fd-47d8-9725-327844285116 req-49cb100f-10be-4481-b03c-c81508150620 tempest-TaggedBootDevicesTest_v242-2032052281 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-2c53aca0-1e9b-4bbe-babc-6ce4761de67d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '461df825-0260-4023-8015-8e60d3fccf71', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:12:04 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-237cfcd5-d0fd-47d8-9725-327844285116 req-49cb100f-10be-4481-b03c-c81508150620 tempest-TaggedBootDevicesTest_v242-2032052281 None] attachment_update completed successfully. Apr 29 17:12:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:12:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:12:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:12:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:12:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:12:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:12:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:12:05 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:12:05 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:12:06 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-251cb35a-9590-4ed6-9e7d-b5b2c322095e req-f8155513-4622-4b40-8a67-52f7ae58b6d2 tempest-ServerActionsTestOtherB-1340184396 None] Terminate volume connection completed successfully. Apr 29 17:12:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-251cb35a-9590-4ed6-9e7d-b5b2c322095e req-f8155513-4622-4b40-8a67-52f7ae58b6d2 tempest-ServerActionsTestOtherB-1340184396 None] Deleting attachment ba00fbf6-8c8f-4302-9bcc-82eaffce0f24. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:12:06 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Apr 29 17:12:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.995s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:12:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:12:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-237cfcd5-d0fd-47d8-9725-327844285116 req-6b0c7a24-e19c-4c60-bc84-22eb9f70dbbe tempest-TaggedBootDevicesTest_v242-2032052281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:12:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-237cfcd5-d0fd-47d8-9725-327844285116 req-6b0c7a24-e19c-4c60-bc84-22eb9f70dbbe tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:12:06 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[285788da-6c81-4149-8ed7-39e4ede53916]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:12:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-237cfcd5-d0fd-47d8-9725-327844285116 req-6b0c7a24-e19c-4c60-bc84-22eb9f70dbbe tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc2610c0-4b4e-42c3-956d-dd4df4118d1c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:12:06 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc2610c0-4b4e-42c3-956d-dd4df4118d1c Apr 29 17:12:06 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:12:07 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Apr 29 17:12:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-237cfcd5-d0fd-47d8-9725-327844285116 req-6b0c7a24-e19c-4c60-bc84-22eb9f70dbbe tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc2610c0-4b4e-42c3-956d-dd4df4118d1c" returned: 0 in 0.890s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:12:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-237cfcd5-d0fd-47d8-9725-327844285116 req-6b0c7a24-e19c-4c60-bc84-22eb9f70dbbe tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.920s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:12:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-237cfcd5-d0fd-47d8-9725-327844285116 req-6b0c7a24-e19c-4c60-bc84-22eb9f70dbbe tempest-TaggedBootDevicesTest_v242-2032052281 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-cc2610c0-4b4e-42c3-956d-dd4df4118d1c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b190893f-adb7-45a2-a22e-084d411512ed', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:12:07 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-237cfcd5-d0fd-47d8-9725-327844285116 req-6b0c7a24-e19c-4c60-bc84-22eb9f70dbbe tempest-TaggedBootDevicesTest_v242-2032052281 None] attachment_update completed successfully. Apr 29 17:12:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-251cb35a-9590-4ed6-9e7d-b5b2c322095e req-daa6541f-1a06-41fd-ba33-4b9d64b10a71 tempest-ServerActionsTestOtherB-1340184396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:12:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-251cb35a-9590-4ed6-9e7d-b5b2c322095e req-daa6541f-1a06-41fd-ba33-4b9d64b10a71 tempest-ServerActionsTestOtherB-1340184396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:12:16 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a8764e-644e-4625-9463-6431cd17d359]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:12:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-251cb35a-9590-4ed6-9e7d-b5b2c322095e req-daa6541f-1a06-41fd-ba33-4b9d64b10a71 tempest-ServerActionsTestOtherB-1340184396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:12:16 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05 Apr 29 17:12:16 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:12:17 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Apr 29 17:12:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-251cb35a-9590-4ed6-9e7d-b5b2c322095e req-daa6541f-1a06-41fd-ba33-4b9d64b10a71 tempest-ServerActionsTestOtherB-1340184396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05" returned: 0 in 0.817s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:12:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-251cb35a-9590-4ed6-9e7d-b5b2c322095e req-daa6541f-1a06-41fd-ba33-4b9d64b10a71 tempest-ServerActionsTestOtherB-1340184396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.844s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:12:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-251cb35a-9590-4ed6-9e7d-b5b2c322095e req-daa6541f-1a06-41fd-ba33-4b9d64b10a71 tempest-ServerActionsTestOtherB-1340184396 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5947dbe-08f4-4e27-ae01-c5a7ffddf49f', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:12:17 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-251cb35a-9590-4ed6-9e7d-b5b2c322095e req-daa6541f-1a06-41fd-ba33-4b9d64b10a71 tempest-ServerActionsTestOtherB-1340184396 None] attachment_update completed successfully. Apr 29 17:12:27 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=47,cinder:UPDATE=17,cinder:INSERT=9 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:12:27 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=20,cinder:SELECT=40,cinder:INSERT=7,cinder:DELETE=3 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:12:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-700b637c-bd6c-4d42-8267-922ebedb8e15 tempest-TaggedBootDevicesTest-1271091301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:12:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-700b637c-bd6c-4d42-8267-922ebedb8e15 tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:12:27 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[5376fc44-eb43-4cad-ac1e-da2f711aaaf9]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:12:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-700b637c-bd6c-4d42-8267-922ebedb8e15 tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:12:27 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb Apr 29 17:12:27 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:12:28 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 29 17:12:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-700b637c-bd6c-4d42-8267-922ebedb8e15 tempest-TaggedBootDevicesTest-1271091301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb" returned: 0 in 0.917s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:12:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-700b637c-bd6c-4d42-8267-922ebedb8e15 tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:12:28 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb Apr 29 17:12:28 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:12:29 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Apr 29 17:12:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-700b637c-bd6c-4d42-8267-922ebedb8e15 tempest-TaggedBootDevicesTest-1271091301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb" returned: 1 in 0.903s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:12:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-700b637c-bd6c-4d42-8267-922ebedb8e15 tempest-TaggedBootDevicesTest-1271091301 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:12:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-700b637c-bd6c-4d42-8267-922ebedb8e15 tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.903s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:12:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-700b637c-bd6c-4d42-8267-922ebedb8e15 tempest-TaggedBootDevicesTest-1271091301 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbfa2fae-eaf1-4fcb-878d-bad97f424663', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:12:29 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-700b637c-bd6c-4d42-8267-922ebedb8e15 tempest-TaggedBootDevicesTest-1271091301 None] attachment_update completed successfully. Apr 29 17:12:29 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-00a80569-1745-4f33-9f4b-2c39b0035162 req-24034c15-fbc5-4298-9052-53ed0e5fd75b tempest-ServerActionsTestOtherB-1340184396 None] Terminate volume connection completed successfully. Apr 29 17:12:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-00a80569-1745-4f33-9f4b-2c39b0035162 req-24034c15-fbc5-4298-9052-53ed0e5fd75b tempest-ServerActionsTestOtherB-1340184396 None] Deleting attachment a5947dbe-08f4-4e27-ae01-c5a7ffddf49f. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Flow 'volume_create_manager' (66460f90-b067-42f9-a449-fdd9b76ab580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6bb0edb-c200-4bc1-8a9e-c7b0009c11ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6bb0edb-c200-4bc1-8a9e-c7b0009c11ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-42646000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d846441-ebdf-4c2d-8cb2-1046e371f6de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cb4e5633277443f83a4f2f2a8d3a242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:12:31Z,use_quota=True,user_id='878aae8024bb41f0840f1e9fb1616461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578bb8d0-9f54-413f-8fd0-51a7eb69df04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578bb8d0-9f54-413f-8fd0-51a7eb69df04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5635c659-1bde-4c21-8abb-d34d2bd94127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5635c659-1bde-4c21-8abb-d34d2bd94127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d846441-ebdf-4c2d-8cb2-1046e371f6de', 'volume_name': 'volume-5d846441-ebdf-4c2d-8cb2-1046e371f6de', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5ce507e-9b29-49ad-88a4-a08c78f4011f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5ce507e-9b29-49ad-88a4-a08c78f4011f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6964bbb4-9f4d-409d-8a26-1db12000f00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:12:30 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Volume 5d846441-ebdf-4c2d-8cb2-1046e371f6de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d846441-ebdf-4c2d-8cb2-1046e371f6de', 'volume_size': 1} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-42646000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d846441-ebdf-4c2d-8cb2-1046e371f6de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cb4e5633277443f83a4f2f2a8d3a242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:12:31Z,use_quota=True,user_id='878aae8024bb41f0840f1e9fb1616461',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Creating volume 5d846441-ebdf-4c2d-8cb2-1046e371f6de {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:12:30 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:12:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d846441-ebdf-4c2d-8cb2-1046e371f6de 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:12:30 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d846441-ebdf-4c2d-8cb2-1046e371f6de 1073741824 Apr 29 17:12:30 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:12:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-03599d0b-526b-4506-ac49-d2815037e350 tempest-TaggedBootDevicesTest-1271091301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:12:31 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Apr 29 17:12:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d846441-ebdf-4c2d-8cb2-1046e371f6de 1073741824" returned: 0 in 1.185s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:12:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d846441-ebdf-4c2d-8cb2-1046e371f6de {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:12:31 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d846441-ebdf-4c2d-8cb2-1046e371f6de Apr 29 17:12:31 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:12:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d66f60ee-92a3-4474-8f7f-6f9917b98352 tempest-ServerActionsTestOtherB-1340184396 None] Acquiring lock "cinder-5d5f91a5-4954-4661-a5bc-d8e586e98a05-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:12:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d66f60ee-92a3-4474-8f7f-6f9917b98352 tempest-ServerActionsTestOtherB-1340184396 None] Lock "cinder-5d5f91a5-4954-4661-a5bc-d8e586e98a05-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:12:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d66f60ee-92a3-4474-8f7f-6f9917b98352 tempest-ServerActionsTestOtherB-1340184396 None] Acquiring lock "cinder-quobyte-5d5f91a5-4954-4661-a5bc-d8e586e98a05" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:12:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d66f60ee-92a3-4474-8f7f-6f9917b98352 tempest-ServerActionsTestOtherB-1340184396 None] Lock "cinder-quobyte-5d5f91a5-4954-4661-a5bc-d8e586e98a05" acquired by "delete_volume" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:12:32 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[676b8d27-9e84-48bc-aee4-790accf369bb]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:12:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d66f60ee-92a3-4474-8f7f-6f9917b98352 tempest-ServerActionsTestOtherB-1340184396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:12:32 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Apr 29 17:12:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d846441-ebdf-4c2d-8cb2-1046e371f6de" returned: 0 in 0.751s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:12:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] <== create_volume: return (1982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:12:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.985s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:12:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-03599d0b-526b-4506-ac49-d2815037e350 tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.325s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:12:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6964bbb4-9f4d-409d-8a26-1db12000f00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d846441-ebdf-4c2d-8cb2-1046e371f6de', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:12:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dbcc4e5-52ff-406d-ba9c-73307c83450c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:12:32 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[183cd014-9755-4227-9a14-859672d5e01d]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:12:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-03599d0b-526b-4506-ac49-d2815037e350 tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8ba75bdc-8c93-41b9-a965-a73db0e30ecb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:12:32 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05 Apr 29 17:12:32 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:12:32 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Volume volume-5d846441-ebdf-4c2d-8cb2-1046e371f6de (5d846441-ebdf-4c2d-8cb2-1046e371f6de): created successfully Apr 29 17:12:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dbcc4e5-52ff-406d-ba9c-73307c83450c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:12:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Flow 'volume_create_manager' (66460f90-b067-42f9-a449-fdd9b76ab580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:12:32 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d8db1f90-74c7-4541-b55c-d86481c23ef3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Created volume successfully. Apr 29 17:12:32 devstack sudo[89033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8ba75bdc-8c93-41b9-a965-a73db0e30ecb Apr 29 17:12:32 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:12:33 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-237cfcd5-d0fd-47d8-9725-327844285116 req-9b541e6d-36a9-4f9f-8eee-cb7a2fea0adb tempest-TaggedBootDevicesTest_v242-2032052281 None] Terminate volume connection completed successfully. Apr 29 17:12:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-237cfcd5-d0fd-47d8-9725-327844285116 req-9b541e6d-36a9-4f9f-8eee-cb7a2fea0adb tempest-TaggedBootDevicesTest_v242-2032052281 None] Deleting attachment 50023377-0132-4819-bc0f-5c1e1aa4c273. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:12:33 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Apr 29 17:12:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d66f60ee-92a3-4474-8f7f-6f9917b98352 tempest-ServerActionsTestOtherB-1340184396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05" returned: 0 in 0.971s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:12:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d66f60ee-92a3-4474-8f7f-6f9917b98352 tempest-ServerActionsTestOtherB-1340184396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:12:33 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05 Apr 29 17:12:33 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:12:33 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root Apr 29 17:12:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-03599d0b-526b-4506-ac49-d2815037e350 tempest-TaggedBootDevicesTest-1271091301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8ba75bdc-8c93-41b9-a965-a73db0e30ecb" returned: 0 in 1.087s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:12:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-03599d0b-526b-4506-ac49-d2815037e350 tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.150s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:12:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-03599d0b-526b-4506-ac49-d2815037e350 tempest-TaggedBootDevicesTest-1271091301 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-8ba75bdc-8c93-41b9-a965-a73db0e30ecb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d84898d-5c2c-4dde-95d5-2ca59ceb5f91', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:12:33 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-03599d0b-526b-4506-ac49-d2815037e350 tempest-TaggedBootDevicesTest-1271091301 None] attachment_update completed successfully. Apr 29 17:12:34 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-237cfcd5-d0fd-47d8-9725-327844285116 req-55bed709-9f76-4d12-86dd-ab0d10c977bf tempest-TaggedBootDevicesTest_v242-2032052281 None] Terminate volume connection completed successfully. Apr 29 17:12:34 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-237cfcd5-d0fd-47d8-9725-327844285116 req-55bed709-9f76-4d12-86dd-ab0d10c977bf tempest-TaggedBootDevicesTest_v242-2032052281 None] Deleting attachment 461df825-0260-4023-8015-8e60d3fccf71. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:12:34 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Apr 29 17:12:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d66f60ee-92a3-4474-8f7f-6f9917b98352 tempest-ServerActionsTestOtherB-1340184396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d5f91a5-4954-4661-a5bc-d8e586e98a05" returned: 0 in 0.687s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:12:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d66f60ee-92a3-4474-8f7f-6f9917b98352 tempest-ServerActionsTestOtherB-1340184396 None] Lock "cinder-quobyte-5d5f91a5-4954-4661-a5bc-d8e586e98a05" released by "delete_volume" :: held 1.712s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:12:34 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-d66f60ee-92a3-4474-8f7f-6f9917b98352 tempest-ServerActionsTestOtherB-1340184396 None] Created reservations ['5452a3cc-00ab-4fcb-9e33-e62e7f75766b', 'b831fb02-5fce-4dc7-bdca-6fcb92c09713', 'a608eeb2-bf88-431b-8492-f3210a21cb19', '4b3e12ed-9c6a-4649-ac25-26a35f33a265'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:12:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d66f60ee-92a3-4474-8f7f-6f9917b98352 tempest-ServerActionsTestOtherB-1340184396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:12:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d66f60ee-92a3-4474-8f7f-6f9917b98352 tempest-ServerActionsTestOtherB-1340184396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:12:34 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d66f60ee-92a3-4474-8f7f-6f9917b98352 tempest-ServerActionsTestOtherB-1340184396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:12:34 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d66f60ee-92a3-4474-8f7f-6f9917b98352 tempest-ServerActionsTestOtherB-1340184396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:12:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d66f60ee-92a3-4474-8f7f-6f9917b98352 tempest-ServerActionsTestOtherB-1340184396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:12:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d66f60ee-92a3-4474-8f7f-6f9917b98352 tempest-ServerActionsTestOtherB-1340184396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:12:34 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:12:34 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:12:34 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-237cfcd5-d0fd-47d8-9725-327844285116 req-4a9d772b-fda3-4793-8f14-b6808d8f8253 tempest-TaggedBootDevicesTest_v242-2032052281 None] Terminate volume connection completed successfully. Apr 29 17:12:34 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-237cfcd5-d0fd-47d8-9725-327844285116 req-4a9d772b-fda3-4793-8f14-b6808d8f8253 tempest-TaggedBootDevicesTest_v242-2032052281 None] Deleting attachment b190893f-adb7-45a2-a22e-084d411512ed. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:12:35 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 29 17:12:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d66f60ee-92a3-4474-8f7f-6f9917b98352 tempest-ServerActionsTestOtherB-1340184396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.784s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:12:35 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-d66f60ee-92a3-4474-8f7f-6f9917b98352 tempest-ServerActionsTestOtherB-1340184396 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:12:35 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d66f60ee-92a3-4474-8f7f-6f9917b98352 tempest-ServerActionsTestOtherB-1340184396 None] Deleted volume successfully. Apr 29 17:12:35 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d66f60ee-92a3-4474-8f7f-6f9917b98352 tempest-ServerActionsTestOtherB-1340184396 None] Lock "cinder-5d5f91a5-4954-4661-a5bc-d8e586e98a05-delete_volume" released by "delete_volume" :: held 2.742s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:12:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-c2a96d21-bdfa-46c6-bac9-abcb6ac32e5c tempest-TaggedBootDevicesTest-1271091301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:12:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-c2a96d21-bdfa-46c6-bac9-abcb6ac32e5c tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:12:35 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a569af7-7e6d-4dc0-a56a-bf6b6adf1d66]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:12:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-c2a96d21-bdfa-46c6-bac9-abcb6ac32e5c tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0a08afc-782f-44d0-875b-9f0bb7f55ee2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:12:36 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0a08afc-782f-44d0-875b-9f0bb7f55ee2 Apr 29 17:12:36 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:12:37 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Apr 29 17:12:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-c2a96d21-bdfa-46c6-bac9-abcb6ac32e5c tempest-TaggedBootDevicesTest-1271091301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0a08afc-782f-44d0-875b-9f0bb7f55ee2" returned: 0 in 1.068s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:12:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-c2a96d21-bdfa-46c6-bac9-abcb6ac32e5c tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.099s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:12:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-c2a96d21-bdfa-46c6-bac9-abcb6ac32e5c tempest-TaggedBootDevicesTest-1271091301 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-c0a08afc-782f-44d0-875b-9f0bb7f55ee2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e87cc47a-ae5d-4c7d-bbb5-f81fae7f1fb1', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:12:37 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-74cd5101-09fc-4711-bd90-e9d0d941e4c1 req-c2a96d21-bdfa-46c6-bac9-abcb6ac32e5c tempest-TaggedBootDevicesTest-1271091301 None] attachment_update completed successfully. Apr 29 17:12:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f3004fc8-8a1a-4927-ae78-2f60e1afcc8e req-f2d2b7ef-db89-494f-8a42-0b3b1322f7d3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:12:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f3004fc8-8a1a-4927-ae78-2f60e1afcc8e req-f2d2b7ef-db89-494f-8a42-0b3b1322f7d3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:12:37 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[403528b6-c81d-4f1d-a1a3-fb3c40a31668]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:12:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f3004fc8-8a1a-4927-ae78-2f60e1afcc8e req-f2d2b7ef-db89-494f-8a42-0b3b1322f7d3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d846441-ebdf-4c2d-8cb2-1046e371f6de {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:12:37 devstack sudo[89074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d846441-ebdf-4c2d-8cb2-1046e371f6de Apr 29 17:12:37 devstack sudo[89074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:12:38 devstack sudo[89074]: pam_unix(sudo:session): session closed for user root Apr 29 17:12:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f3004fc8-8a1a-4927-ae78-2f60e1afcc8e req-f2d2b7ef-db89-494f-8a42-0b3b1322f7d3 tempest-AttachSCSIVolumeTestJSON-456603525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d846441-ebdf-4c2d-8cb2-1046e371f6de" returned: 0 in 0.928s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:12:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f3004fc8-8a1a-4927-ae78-2f60e1afcc8e req-f2d2b7ef-db89-494f-8a42-0b3b1322f7d3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.959s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:12:38 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f3004fc8-8a1a-4927-ae78-2f60e1afcc8e req-f2d2b7ef-db89-494f-8a42-0b3b1322f7d3 tempest-AttachSCSIVolumeTestJSON-456603525 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-5d846441-ebdf-4c2d-8cb2-1046e371f6de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '595003ce-38aa-4f3b-8c36-1729a04c9595', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:12:38 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-f3004fc8-8a1a-4927-ae78-2f60e1afcc8e req-f2d2b7ef-db89-494f-8a42-0b3b1322f7d3 tempest-AttachSCSIVolumeTestJSON-456603525 None] attachment_update completed successfully. Apr 29 17:12:45 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-0620f055-c04e-4caa-80d2-ba7f7865ec84 req-c37f02a1-bf28-407e-8b8f-42ace0cc0c6d tempest-AttachSCSIVolumeTestJSON-456603525 None] Terminate volume connection completed successfully. Apr 29 17:12:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-0620f055-c04e-4caa-80d2-ba7f7865ec84 req-c37f02a1-bf28-407e-8b8f-42ace0cc0c6d tempest-AttachSCSIVolumeTestJSON-456603525 None] Deleting attachment 595003ce-38aa-4f3b-8c36-1729a04c9595. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:12:48 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=34,cinder:INSERT=3,cinder:UPDATE=13 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:12:55 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=34,cinder:UPDATE=21,cinder:DELETE=2,cinder:INSERT=2 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:12:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-146f9ef3-247a-4bbf-abb0-aeb8038d7214 tempest-TaggedBootDevicesTest_v242-2032052281 None] Acquiring lock "cinder-cc2610c0-4b4e-42c3-956d-dd4df4118d1c-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:12:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-146f9ef3-247a-4bbf-abb0-aeb8038d7214 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "cinder-cc2610c0-4b4e-42c3-956d-dd4df4118d1c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:12:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-146f9ef3-247a-4bbf-abb0-aeb8038d7214 tempest-TaggedBootDevicesTest_v242-2032052281 None] Acquiring lock "cinder-quobyte-cc2610c0-4b4e-42c3-956d-dd4df4118d1c" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:12:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-146f9ef3-247a-4bbf-abb0-aeb8038d7214 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "cinder-quobyte-cc2610c0-4b4e-42c3-956d-dd4df4118d1c" acquired by "delete_volume" :: waited 0.026s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:12:57 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b499a2d0-a765-4b24-9d88-8083a39baf7a]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:12:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-146f9ef3-247a-4bbf-abb0-aeb8038d7214 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc2610c0-4b4e-42c3-956d-dd4df4118d1c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:12:57 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc2610c0-4b4e-42c3-956d-dd4df4118d1c Apr 29 17:12:57 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:12:58 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Apr 29 17:12:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-146f9ef3-247a-4bbf-abb0-aeb8038d7214 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc2610c0-4b4e-42c3-956d-dd4df4118d1c" returned: 0 in 0.803s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:12:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-146f9ef3-247a-4bbf-abb0-aeb8038d7214 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc2610c0-4b4e-42c3-956d-dd4df4118d1c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:12:58 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc2610c0-4b4e-42c3-956d-dd4df4118d1c Apr 29 17:12:58 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:12:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f2945110-598d-4d90-a4b8-65061ebe5519 tempest-AttachSCSIVolumeTestJSON-456603525 None] Acquiring lock "cinder-5d846441-ebdf-4c2d-8cb2-1046e371f6de-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:12:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f2945110-598d-4d90-a4b8-65061ebe5519 tempest-AttachSCSIVolumeTestJSON-456603525 None] Lock "cinder-5d846441-ebdf-4c2d-8cb2-1046e371f6de-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:12:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f2945110-598d-4d90-a4b8-65061ebe5519 tempest-AttachSCSIVolumeTestJSON-456603525 None] Acquiring lock "cinder-quobyte-5d846441-ebdf-4c2d-8cb2-1046e371f6de" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:12:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f2945110-598d-4d90-a4b8-65061ebe5519 tempest-AttachSCSIVolumeTestJSON-456603525 None] Lock "cinder-quobyte-5d846441-ebdf-4c2d-8cb2-1046e371f6de" acquired by "delete_volume" :: waited 0.021s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:12:58 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34b40d2-046c-4437-81c9-b343729d5996]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:12:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f2945110-598d-4d90-a4b8-65061ebe5519 tempest-AttachSCSIVolumeTestJSON-456603525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d846441-ebdf-4c2d-8cb2-1046e371f6de {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:12:58 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d846441-ebdf-4c2d-8cb2-1046e371f6de Apr 29 17:12:58 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:12:58 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Apr 29 17:12:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-146f9ef3-247a-4bbf-abb0-aeb8038d7214 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc2610c0-4b4e-42c3-956d-dd4df4118d1c" returned: 0 in 0.893s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:12:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-146f9ef3-247a-4bbf-abb0-aeb8038d7214 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "cinder-quobyte-cc2610c0-4b4e-42c3-956d-dd4df4118d1c" released by "delete_volume" :: held 1.771s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:12:59 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-146f9ef3-247a-4bbf-abb0-aeb8038d7214 tempest-TaggedBootDevicesTest_v242-2032052281 None] Created reservations ['8c4f0b26-d7a8-46ca-84f8-cd4f9f131446', 'f0e08ce8-8948-422e-9f46-040b1121a2e5', 'f89180ba-0adf-419c-8970-b88efa6e1348', '16175b1f-2467-44b8-91bd-7adca752a4ed'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:12:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-146f9ef3-247a-4bbf-abb0-aeb8038d7214 tempest-TaggedBootDevicesTest_v242-2032052281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:12:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-146f9ef3-247a-4bbf-abb0-aeb8038d7214 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:12:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-146f9ef3-247a-4bbf-abb0-aeb8038d7214 tempest-TaggedBootDevicesTest_v242-2032052281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:12:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-146f9ef3-247a-4bbf-abb0-aeb8038d7214 tempest-TaggedBootDevicesTest_v242-2032052281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:12:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-146f9ef3-247a-4bbf-abb0-aeb8038d7214 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:12:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-146f9ef3-247a-4bbf-abb0-aeb8038d7214 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:12:59 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:12:59 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:12:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b1016018-f343-4609-a611-abb5c5d988be tempest-TaggedBootDevicesTest_v242-2032052281 None] Acquiring lock "cinder-2c53aca0-1e9b-4bbe-babc-6ce4761de67d-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:12:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b1016018-f343-4609-a611-abb5c5d988be tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "cinder-2c53aca0-1e9b-4bbe-babc-6ce4761de67d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:12:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b1016018-f343-4609-a611-abb5c5d988be tempest-TaggedBootDevicesTest_v242-2032052281 None] Acquiring lock "cinder-quobyte-2c53aca0-1e9b-4bbe-babc-6ce4761de67d" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:12:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b1016018-f343-4609-a611-abb5c5d988be tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "cinder-quobyte-2c53aca0-1e9b-4bbe-babc-6ce4761de67d" acquired by "delete_volume" :: waited 0.034s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:12:59 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83cefb8-b03b-4400-aa38-fe38644dac6c]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:12:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b1016018-f343-4609-a611-abb5c5d988be tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c53aca0-1e9b-4bbe-babc-6ce4761de67d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:12:59 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Apr 29 17:12:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f2945110-598d-4d90-a4b8-65061ebe5519 tempest-AttachSCSIVolumeTestJSON-456603525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d846441-ebdf-4c2d-8cb2-1046e371f6de" returned: 0 in 1.001s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:12:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f2945110-598d-4d90-a4b8-65061ebe5519 tempest-AttachSCSIVolumeTestJSON-456603525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d846441-ebdf-4c2d-8cb2-1046e371f6de {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:12:59 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d846441-ebdf-4c2d-8cb2-1046e371f6de Apr 29 17:12:59 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:12:59 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c53aca0-1e9b-4bbe-babc-6ce4761de67d Apr 29 17:12:59 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:00 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-146f9ef3-247a-4bbf-abb0-aeb8038d7214 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.837s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:00 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-146f9ef3-247a-4bbf-abb0-aeb8038d7214 tempest-TaggedBootDevicesTest_v242-2032052281 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:13:00 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-146f9ef3-247a-4bbf-abb0-aeb8038d7214 tempest-TaggedBootDevicesTest_v242-2032052281 None] Deleted volume successfully. Apr 29 17:13:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-146f9ef3-247a-4bbf-abb0-aeb8038d7214 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "cinder-cc2610c0-4b4e-42c3-956d-dd4df4118d1c-delete_volume" released by "delete_volume" :: held 2.981s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:13:00 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:00 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b1016018-f343-4609-a611-abb5c5d988be tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c53aca0-1e9b-4bbe-babc-6ce4761de67d" returned: 0 in 1.019s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f2945110-598d-4d90-a4b8-65061ebe5519 tempest-AttachSCSIVolumeTestJSON-456603525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5d846441-ebdf-4c2d-8cb2-1046e371f6de" returned: 0 in 0.981s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b1016018-f343-4609-a611-abb5c5d988be tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c53aca0-1e9b-4bbe-babc-6ce4761de67d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:00 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c53aca0-1e9b-4bbe-babc-6ce4761de67d Apr 29 17:13:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f2945110-598d-4d90-a4b8-65061ebe5519 tempest-AttachSCSIVolumeTestJSON-456603525 None] Lock "cinder-quobyte-5d846441-ebdf-4c2d-8cb2-1046e371f6de" released by "delete_volume" :: held 2.124s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:13:00 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:00 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-f2945110-598d-4d90-a4b8-65061ebe5519 tempest-AttachSCSIVolumeTestJSON-456603525 None] Created reservations ['a7257736-4f54-455d-870b-cccfd8023929', 'cebf9416-9388-4c8a-a37e-6f0e785ded1e', '8d79a884-b52d-44e4-ad74-8d0a83491201', '43a5468c-ac25-40b3-9071-f8211639d612'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:13:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f2945110-598d-4d90-a4b8-65061ebe5519 tempest-AttachSCSIVolumeTestJSON-456603525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:13:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f2945110-598d-4d90-a4b8-65061ebe5519 tempest-AttachSCSIVolumeTestJSON-456603525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:13:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f2945110-598d-4d90-a4b8-65061ebe5519 tempest-AttachSCSIVolumeTestJSON-456603525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:13:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f2945110-598d-4d90-a4b8-65061ebe5519 tempest-AttachSCSIVolumeTestJSON-456603525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:13:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f2945110-598d-4d90-a4b8-65061ebe5519 tempest-AttachSCSIVolumeTestJSON-456603525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:13:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f2945110-598d-4d90-a4b8-65061ebe5519 tempest-AttachSCSIVolumeTestJSON-456603525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:01 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:13:01 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:01 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b1016018-f343-4609-a611-abb5c5d988be tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c53aca0-1e9b-4bbe-babc-6ce4761de67d" returned: 0 in 0.713s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b1016018-f343-4609-a611-abb5c5d988be tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "cinder-quobyte-2c53aca0-1e9b-4bbe-babc-6ce4761de67d" released by "delete_volume" :: held 1.791s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:13:01 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-b1016018-f343-4609-a611-abb5c5d988be tempest-TaggedBootDevicesTest_v242-2032052281 None] Created reservations ['4c85e6e5-6cc1-4a16-8a85-f54d9f25d8fc', 'cf2a1fc8-3156-479a-85cd-88e7396853bb', '2114e1cc-8abf-440e-8649-29897c760931', '194e82e3-441b-468b-86f7-620e4b9a35b0'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:13:01 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f2945110-598d-4d90-a4b8-65061ebe5519 tempest-AttachSCSIVolumeTestJSON-456603525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.627s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:01 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-f2945110-598d-4d90-a4b8-65061ebe5519 tempest-AttachSCSIVolumeTestJSON-456603525 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:13:01 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f2945110-598d-4d90-a4b8-65061ebe5519 tempest-AttachSCSIVolumeTestJSON-456603525 None] Deleted volume successfully. Apr 29 17:13:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b1016018-f343-4609-a611-abb5c5d988be tempest-TaggedBootDevicesTest_v242-2032052281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:13:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b1016018-f343-4609-a611-abb5c5d988be tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:13:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b1016018-f343-4609-a611-abb5c5d988be tempest-TaggedBootDevicesTest_v242-2032052281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:13:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b1016018-f343-4609-a611-abb5c5d988be tempest-TaggedBootDevicesTest_v242-2032052281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:13:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b1016018-f343-4609-a611-abb5c5d988be tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:13:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b1016018-f343-4609-a611-abb5c5d988be tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f2945110-598d-4d90-a4b8-65061ebe5519 tempest-AttachSCSIVolumeTestJSON-456603525 None] Lock "cinder-5d846441-ebdf-4c2d-8cb2-1046e371f6de-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:13:01 devstack sudo[89740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:13:01 devstack sudo[89740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] Acquiring lock "cinder-cc050001-054a-4e6d-ae2e-4954ebd03ea2-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:13:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "cinder-cc050001-054a-4e6d-ae2e-4954ebd03ea2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:13:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] Acquiring lock "cinder-quobyte-cc050001-054a-4e6d-ae2e-4954ebd03ea2" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:13:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "cinder-quobyte-cc050001-054a-4e6d-ae2e-4954ebd03ea2" acquired by "delete_volume" :: waited 0.028s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:13:02 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cff208-fa62-44a1-b977-b428d6defbb5]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:13:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:02 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 Apr 29 17:13:02 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:02 devstack sudo[89740]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b1016018-f343-4609-a611-abb5c5d988be tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.851s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:02 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-b1016018-f343-4609-a611-abb5c5d988be tempest-TaggedBootDevicesTest_v242-2032052281 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:13:02 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-b1016018-f343-4609-a611-abb5c5d988be tempest-TaggedBootDevicesTest_v242-2032052281 None] Deleted volume successfully. Apr 29 17:13:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b1016018-f343-4609-a611-abb5c5d988be tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "cinder-2c53aca0-1e9b-4bbe-babc-6ce4761de67d-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:13:03 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2" returned: 0 in 1.141s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:03 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 Apr 29 17:13:03 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:04 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2" returned: 1 in 0.853s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:13:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:04 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2 Apr 29 17:13:04 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:04 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cc050001-054a-4e6d-ae2e-4954ebd03ea2" returned: 0 in 0.838s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "cinder-quobyte-cc050001-054a-4e6d-ae2e-4954ebd03ea2" released by "delete_volume" :: held 2.922s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:13:04 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] Created reservations ['2ca57617-cf26-4d76-8645-39d39602d74b', 'ba3a8e3b-6a15-4851-8ec4-01150f0c51e5', '28337615-cfe4-47ad-a7f6-5a0471bc911e', '7e309378-cc15-4f27-9bfc-b1c5d5dbbe3a'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:13:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:13:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:13:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:13:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:13:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:13:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:05 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:13:05 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:13:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:13:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:13:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:13:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:13:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:13:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:05 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:13:05 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:05 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.802s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:05 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:13:05 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] Deleted volume successfully. Apr 29 17:13:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-87b58eeb-808a-419c-9101-a357afdb5c41 tempest-TaggedBootDevicesTest_v242-2032052281 None] Lock "cinder-cc050001-054a-4e6d-ae2e-4954ebd03ea2-delete_volume" released by "delete_volume" :: held 3.982s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:13:06 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.887s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:13:06 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:13:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Flow 'volume_create_manager' (8ce960fa-1ca7-49c6-9fa8-870926a37301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:13:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09cf70c2-6b77-46c2-9278-3cf5e150c277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:13:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09cf70c2-6b77-46c2-9278-3cf5e150c277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-339181610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f089b9c8-2829-47cb-94fa-ecaf54255f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ef00b16738447cb8d78775a5de6ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:13:06Z,use_quota=True,user_id='abbfd9c5ecd34e828aa37e23c3826fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:13:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f73f6a-9421-475e-875c-68f905aa675b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:13:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f73f6a-9421-475e-875c-68f905aa675b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:13:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5768a05-f0c6-486e-b91c-93c5fbd293df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:13:06 devstack cinder-volume[84547]: DEBUG cinder.image.glance [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Creating Keystone auth plugin from conf {{(pid=84547) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 17:13:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5768a05-f0c6-486e-b91c-93c5fbd293df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f089b9c8-2829-47cb-94fa-ecaf54255f6a', 'volume_name': 'volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:13:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e36085-02c0-4117-bebc-41840e797331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:13:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e36085-02c0-4117-bebc-41840e797331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:13:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175f3531-c3ca-4129-a6e5-fbea81fc270f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:13:06 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Volume f089b9c8-2829-47cb-94fa-ecaf54255f6a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 17:13:06 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Trying to clone f089b9c8-2829-47cb-94fa-ecaf54255f6a from image 982d68c3-05b9-445d-85e5-5c92642a92aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]). {{(pid=84547) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 17:13:07 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ze7peyindevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 17:13:07 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Image download 20.69 MB at 20.69 MB/s Apr 29 17:13:07 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc1f5fd-b15d-4fdb-a30f-d87a7f42cbe2]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:13:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ze7peyindevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:07 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ze7peyindevstack@QuobyteHD Apr 29 17:13:07 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:09 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ze7peyindevstack@QuobyteHD" returned: 0 in 1.802s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:09 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Temporary image 982d68c3-05b9-445d-85e5-5c92642a92aa is fetched for user abbfd9c5ecd34e828aa37e23c3826fa3. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 17:13:09 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a2121e-7467-4f22-99df-f3c11376431c]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:13:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ze7peyindevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:09 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ze7peyindevstack@QuobyteHD Apr 29 17:13:09 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:10 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ze7peyindevstack@QuobyteHD" returned: 0 in 1.201s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:13:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:13:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-339181610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f089b9c8-2829-47cb-94fa-ecaf54255f6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7ef00b16738447cb8d78775a5de6ff6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:13:06Z,use_quota=True,user_id='abbfd9c5ecd34e828aa37e23c3826fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:13:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Creating volume f089b9c8-2829-47cb-94fa-ecaf54255f6a {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:13:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:13:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:13:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:13:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:13:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:13:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:13:10 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:13:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:10 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a 1073741824 Apr 29 17:13:10 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:11 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a 1073741824" returned: 0 in 1.399s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:11 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a Apr 29 17:13:11 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:12 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a" returned: 0 in 0.826s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] <== create_volume: return (2323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:13:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.325s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:13:12 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Attempting download of 982d68c3-05b9-445d-85e5-5c92642a92aa ((None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}])) to volume f089b9c8-2829-47cb-94fa-ecaf54255f6a. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 17:13:12 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff3e01e-033e-49c7-8cef-c80bd9f350d2]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:13:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_ihjby9m2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:13 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_ihjby9m2 Apr 29 17:13:13 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:13 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_ihjby9m2" returned: 0 in 0.960s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_ihjby9m2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:13 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_ihjby9m2 Apr 29 17:13:13 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:14 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_ihjby9m2" returned: 1 in 0.812s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_ihjby9m2' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:13:14 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d098c8d2-b12e-422e-a817-968199c13a63]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:13:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ze7peyindevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:14 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ze7peyindevstack@QuobyteHD Apr 29 17:13:14 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:15 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ze7peyindevstack@QuobyteHD" returned: 0 in 0.813s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:15 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] 982d68c3-05b9-445d-85e5-5c92642a92aa was qcow2, converting to raw {{(pid=84547) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 17:13:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ze7peyindevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:15 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ze7peyindevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a Apr 29 17:13:15 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:18 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ze7peyindevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a" returned: 0 in 2.653s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:18 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_ze7peyindevstack@QuobyteHD, size 112.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:13:18 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Converted 112.00 MB image at 42.11 MB/s Apr 29 17:13:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:18 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a 1G Apr 29 17:13:18 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:19 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a 1G" returned: 0 in 1.498s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:19 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfa6f4d-bfb9-4a68-aab9-90bfd672ba02]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:13:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:19 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a Apr 29 17:13:19 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:20 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a" returned: 0 in 1.108s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:20 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a Apr 29 17:13:20 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:21 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a" returned: 1 in 0.812s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:13:21 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Downloaded image 982d68c3-05b9-445d-85e5-5c92642a92aa ((None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}])) to volume f089b9c8-2829-47cb-94fa-ecaf54255f6a successfully. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 17:13:21 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Temporary image 982d68c3-05b9-445d-85e5-5c92642a92aa for user abbfd9c5ecd34e828aa37e23c3826fa3 is deleted. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 17:13:21 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Marking volume f089b9c8-2829-47cb-94fa-ecaf54255f6a as bootable. {{(pid=84547) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 17:13:21 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Copying metadata from image 982d68c3-05b9-445d-85e5-5c92642a92aa to f089b9c8-2829-47cb-94fa-ecaf54255f6a. {{(pid=84547) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 17:13:21 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Creating volume glance metadata for volume f089b9c8-2829-47cb-94fa-ecaf54255f6a backed by image 982d68c3-05b9-445d-85e5-5c92642a92aa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84547) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 17:13:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175f3531-c3ca-4129-a6e5-fbea81fc270f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:13:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb974cb-a83c-4af9-aabb-0be0a3d0802d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:13:21 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Volume volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a (f089b9c8-2829-47cb-94fa-ecaf54255f6a): created successfully Apr 29 17:13:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb974cb-a83c-4af9-aabb-0be0a3d0802d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:13:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Flow 'volume_create_manager' (8ce960fa-1ca7-49c6-9fa8-870926a37301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:13:22 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d7af4a5e-4eda-478d-9fef-652d0b504c2d tempest-ServerActionsV293TestJSON-1455016196 None] Created volume successfully. Apr 29 17:13:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-3aa9ab57-d6a0-4c99-9304-bf79f58a68da req-c7ee7394-00d9-4542-ada7-22657876ec14 tempest-ServerActionsV293TestJSON-1455016196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:13:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-3aa9ab57-d6a0-4c99-9304-bf79f58a68da req-c7ee7394-00d9-4542-ada7-22657876ec14 tempest-ServerActionsV293TestJSON-1455016196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:13:31 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[656f88d6-87fc-41d8-8444-fc1581f1cacd]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:13:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-3aa9ab57-d6a0-4c99-9304-bf79f58a68da req-c7ee7394-00d9-4542-ada7-22657876ec14 tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:31 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a Apr 29 17:13:31 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:32 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=30,cinder:UPDATE=36,cinder:INSERT=17,cinder:DELETE=4 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:13:32 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-3aa9ab57-d6a0-4c99-9304-bf79f58a68da req-c7ee7394-00d9-4542-ada7-22657876ec14 tempest-ServerActionsV293TestJSON-1455016196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a" returned: 0 in 1.291s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-3aa9ab57-d6a0-4c99-9304-bf79f58a68da req-c7ee7394-00d9-4542-ada7-22657876ec14 tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:13:32 devstack sudo[90534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a Apr 29 17:13:32 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:13:33 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root Apr 29 17:13:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-3aa9ab57-d6a0-4c99-9304-bf79f58a68da req-c7ee7394-00d9-4542-ada7-22657876ec14 tempest-ServerActionsV293TestJSON-1455016196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a" returned: 1 in 1.072s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:13:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-3aa9ab57-d6a0-4c99-9304-bf79f58a68da req-c7ee7394-00d9-4542-ada7-22657876ec14 tempest-ServerActionsV293TestJSON-1455016196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:13:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-3aa9ab57-d6a0-4c99-9304-bf79f58a68da req-c7ee7394-00d9-4542-ada7-22657876ec14 tempest-ServerActionsV293TestJSON-1455016196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.431s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:13:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-3aa9ab57-d6a0-4c99-9304-bf79f58a68da req-c7ee7394-00d9-4542-ada7-22657876ec14 tempest-ServerActionsV293TestJSON-1455016196 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a2364cb-26af-42a7-bb19-238950bd5b2a', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:13:33 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-3aa9ab57-d6a0-4c99-9304-bf79f58a68da req-c7ee7394-00d9-4542-ada7-22657876ec14 tempest-ServerActionsV293TestJSON-1455016196 None] attachment_update completed successfully. Apr 29 17:13:50 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=37,cinder:UPDATE=38,cinder:INSERT=13,cinder:DELETE=1 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:13:50 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:14:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:14:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:14:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:14:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:14:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:14:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:14:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:05 devstack sudo[90993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:14:05 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:08 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 2.937s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:08 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Flow 'volume_create_manager' (357ab630-aa5d-4420-98e8-424f1f65d29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d67e005-11ba-477b-8c2d-c432a647f519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d67e005-11ba-477b-8c2d-c432a647f519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-105387616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2c21a9-4515-4581-af2c-01338db1cbb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='973d10520e8b4de493f2bc87ca1c5575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:14:22Z,use_quota=True,user_id='4d8f41f5db9a4d21bb777decd858b6db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418566e6-daeb-4721-be03-0e7c8770cb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418566e6-daeb-4721-be03-0e7c8770cb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d789ba3-3175-4c37-a6a7-5babe71d000c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d789ba3-3175-4c37-a6a7-5babe71d000c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f2c21a9-4515-4581-af2c-01338db1cbb7', 'volume_name': 'volume-9f2c21a9-4515-4581-af2c-01338db1cbb7', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de784b3-29ba-47a0-8626-40e3e39ad6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de784b3-29ba-47a0-8626-40e3e39ad6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f655987-60ff-45ea-9d28-0a3e43797cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:14:22 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Volume 9f2c21a9-4515-4581-af2c-01338db1cbb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f2c21a9-4515-4581-af2c-01338db1cbb7', 'volume_size': 1} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-105387616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2c21a9-4515-4581-af2c-01338db1cbb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='973d10520e8b4de493f2bc87ca1c5575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:14:22Z,use_quota=True,user_id='4d8f41f5db9a4d21bb777decd858b6db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Creating volume 9f2c21a9-4515-4581-af2c-01338db1cbb7 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:14:22 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:14:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9f2c21a9-4515-4581-af2c-01338db1cbb7 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:22 devstack sudo[91533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9f2c21a9-4515-4581-af2c-01338db1cbb7 1073741824 Apr 29 17:14:22 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:24 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9f2c21a9-4515-4581-af2c-01338db1cbb7 1073741824" returned: 0 in 1.463s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9f2c21a9-4515-4581-af2c-01338db1cbb7 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:24 devstack sudo[91576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9f2c21a9-4515-4581-af2c-01338db1cbb7 Apr 29 17:14:24 devstack sudo[91576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:24 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-c609edd4-1ed3-4b43-abe3-84a6a3c56e24 req-ad345780-f96f-401c-bc85-6fdb560ecca8 tempest-TaggedBootDevicesTest-1271091301 None] Terminate volume connection completed successfully. Apr 29 17:14:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-c609edd4-1ed3-4b43-abe3-84a6a3c56e24 req-ad345780-f96f-401c-bc85-6fdb560ecca8 tempest-TaggedBootDevicesTest-1271091301 None] Deleting attachment fbfa2fae-eaf1-4fcb-878d-bad97f424663. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:14:24 devstack sudo[91576]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9f2c21a9-4515-4581-af2c-01338db1cbb7" returned: 0 in 0.736s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] <== create_volume: return (2282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:14:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.286s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:14:25 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f655987-60ff-45ea-9d28-0a3e43797cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f2c21a9-4515-4581-af2c-01338db1cbb7', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:14:25 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e665522-f704-4902-a46e-ee19d7d3a721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:14:25 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Volume volume-9f2c21a9-4515-4581-af2c-01338db1cbb7 (9f2c21a9-4515-4581-af2c-01338db1cbb7): created successfully Apr 29 17:14:25 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e665522-f704-4902-a46e-ee19d7d3a721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:14:25 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Flow 'volume_create_manager' (357ab630-aa5d-4420-98e8-424f1f65d29a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:14:25 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-3785c383-de51-4936-a40f-50175cdf4db2 tempest-ServerRescueNegativeTestJSON-1326654837 None] Created volume successfully. Apr 29 17:14:25 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-c609edd4-1ed3-4b43-abe3-84a6a3c56e24 req-c9a5afb7-e86c-4a7f-b3dd-b2a4cf14ff2b tempest-TaggedBootDevicesTest-1271091301 None] Terminate volume connection completed successfully. Apr 29 17:14:25 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-c609edd4-1ed3-4b43-abe3-84a6a3c56e24 req-c9a5afb7-e86c-4a7f-b3dd-b2a4cf14ff2b tempest-TaggedBootDevicesTest-1271091301 None] Deleting attachment 5d84898d-5c2c-4dde-95d5-2ca59ceb5f91. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:14:26 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-c609edd4-1ed3-4b43-abe3-84a6a3c56e24 req-9b9dc0ed-ba5e-4d47-aad7-2215e16156ef tempest-TaggedBootDevicesTest-1271091301 None] Terminate volume connection completed successfully. Apr 29 17:14:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-c609edd4-1ed3-4b43-abe3-84a6a3c56e24 req-9b9dc0ed-ba5e-4d47-aad7-2215e16156ef tempest-TaggedBootDevicesTest-1271091301 None] Deleting attachment e87cc47a-ae5d-4c7d-bbb5-f81fae7f1fb1. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Flow 'volume_create_manager' (5aac5d02-b008-46fa-b10f-8efc677b33f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec8dabc-93f1-4051-acff-d9ca73d1d0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec8dabc-93f1-4051-acff-d9ca73d1d0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:14:32Z,deleted=False,deleted_at=None,display_description='',display_name='e3c8f27b-9d70-49d9-920d-439e075c937d-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdce866c-7f85-4f3b-9b85-36c04bb0482e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abbf47527e4b4d79b618a1bb00dcdf74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:14:32Z,use_quota=True,user_id='5db80bb202c04267838b9cb45296e5c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f284774-7e25-4f34-be8a-4b0313cac0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f284774-7e25-4f34-be8a-4b0313cac0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9586733c-50ae-4b39-804f-8f8fdbbd82b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9586733c-50ae-4b39-804f-8f8fdbbd82b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdce866c-7f85-4f3b-9b85-36c04bb0482e', 'volume_name': 'volume-bdce866c-7f85-4f3b-9b85-36c04bb0482e', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4199e9-e6db-401f-ad5d-40315817b00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4199e9-e6db-401f-ad5d-40315817b00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d7658c-4dd5-477e-9fae-5c701078904b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:14:32 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Volume bdce866c-7f85-4f3b-9b85-36c04bb0482e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdce866c-7f85-4f3b-9b85-36c04bb0482e', 'volume_size': 1} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:14:32Z,deleted=False,deleted_at=None,display_description='',display_name='e3c8f27b-9d70-49d9-920d-439e075c937d-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdce866c-7f85-4f3b-9b85-36c04bb0482e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abbf47527e4b4d79b618a1bb00dcdf74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:14:32Z,use_quota=True,user_id='5db80bb202c04267838b9cb45296e5c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Creating volume bdce866c-7f85-4f3b-9b85-36c04bb0482e {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:14:32 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:14:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bdce866c-7f85-4f3b-9b85-36c04bb0482e 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:32 devstack sudo[91621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bdce866c-7f85-4f3b-9b85-36c04bb0482e 1073741824 Apr 29 17:14:32 devstack sudo[91621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:33 devstack sudo[91621]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bdce866c-7f85-4f3b-9b85-36c04bb0482e 1073741824" returned: 0 in 1.176s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bdce866c-7f85-4f3b-9b85-36c04bb0482e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:33 devstack sudo[91627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bdce866c-7f85-4f3b-9b85-36c04bb0482e Apr 29 17:14:33 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:34 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bdce866c-7f85-4f3b-9b85-36c04bb0482e" returned: 0 in 1.162s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:34 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] <== create_volume: return (2470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:14:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.473s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:14:35 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d7658c-4dd5-477e-9fae-5c701078904b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdce866c-7f85-4f3b-9b85-36c04bb0482e', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:14:35 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d18ca27-c305-4b56-b3ff-5ac6764ff3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:14:35 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Volume volume-bdce866c-7f85-4f3b-9b85-36c04bb0482e (bdce866c-7f85-4f3b-9b85-36c04bb0482e): created successfully Apr 29 17:14:35 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d18ca27-c305-4b56-b3ff-5ac6764ff3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:14:35 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Flow 'volume_create_manager' (5aac5d02-b008-46fa-b10f-8efc677b33f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:14:35 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-0cfb6149-20ce-42b7-b7dd-245c8c02ceb3 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Created volume successfully. Apr 29 17:14:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-8da70423-4758-4b71-a929-4a6a9e7a0587 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:14:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-8da70423-4758-4b71-a929-4a6a9e7a0587 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:14:36 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cca500e-ad8c-443b-a8ce-89b0b139746d]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:14:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-8da70423-4758-4b71-a929-4a6a9e7a0587 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bdce866c-7f85-4f3b-9b85-36c04bb0482e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:36 devstack sudo[91702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bdce866c-7f85-4f3b-9b85-36c04bb0482e Apr 29 17:14:36 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:37 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-8da70423-4758-4b71-a929-4a6a9e7a0587 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bdce866c-7f85-4f3b-9b85-36c04bb0482e" returned: 0 in 1.888s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-8da70423-4758-4b71-a929-4a6a9e7a0587 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.929s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:14:38 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-8da70423-4758-4b71-a929-4a6a9e7a0587 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-bdce866c-7f85-4f3b-9b85-36c04bb0482e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e833bb77-bc1f-4eab-94cb-07733acf827d', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:14:38 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-8da70423-4758-4b71-a929-4a6a9e7a0587 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] attachment_update completed successfully. Apr 29 17:14:39 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5f72f2d0-796d-4e77-89ad-8beea52aeb1a tempest-TaggedBootDevicesTest-1271091301 None] Acquiring lock "cinder-c0a08afc-782f-44d0-875b-9f0bb7f55ee2-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:14:39 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5f72f2d0-796d-4e77-89ad-8beea52aeb1a tempest-TaggedBootDevicesTest-1271091301 None] Lock "cinder-c0a08afc-782f-44d0-875b-9f0bb7f55ee2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:14:39 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5f72f2d0-796d-4e77-89ad-8beea52aeb1a tempest-TaggedBootDevicesTest-1271091301 None] Acquiring lock "cinder-quobyte-c0a08afc-782f-44d0-875b-9f0bb7f55ee2" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:14:39 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5f72f2d0-796d-4e77-89ad-8beea52aeb1a tempest-TaggedBootDevicesTest-1271091301 None] Lock "cinder-quobyte-c0a08afc-782f-44d0-875b-9f0bb7f55ee2" acquired by "delete_volume" :: waited 0.027s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:14:39 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ffe0ea-421f-4f89-a142-1df5db1b0271]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:14:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5f72f2d0-796d-4e77-89ad-8beea52aeb1a tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0a08afc-782f-44d0-875b-9f0bb7f55ee2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:39 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0a08afc-782f-44d0-875b-9f0bb7f55ee2 Apr 29 17:14:39 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:41 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5f72f2d0-796d-4e77-89ad-8beea52aeb1a tempest-TaggedBootDevicesTest-1271091301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0a08afc-782f-44d0-875b-9f0bb7f55ee2" returned: 0 in 1.774s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5f72f2d0-796d-4e77-89ad-8beea52aeb1a tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0a08afc-782f-44d0-875b-9f0bb7f55ee2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:41 devstack sudo[91861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0a08afc-782f-44d0-875b-9f0bb7f55ee2 Apr 29 17:14:41 devstack sudo[91861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:41 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-5df388d2-e676-48c0-82ff-779091b42293 req-d7864342-454c-463f-9dc7-8a489f1767ce tempest-ServerActionsV293TestJSON-1455016196 None] Terminate volume connection completed successfully. Apr 29 17:14:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-5df388d2-e676-48c0-82ff-779091b42293 req-d7864342-454c-463f-9dc7-8a489f1767ce tempest-ServerActionsV293TestJSON-1455016196 None] Deleting attachment 1a2364cb-26af-42a7-bb19-238950bd5b2a. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:14:42 devstack sudo[91861]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5f72f2d0-796d-4e77-89ad-8beea52aeb1a tempest-TaggedBootDevicesTest-1271091301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0a08afc-782f-44d0-875b-9f0bb7f55ee2" returned: 0 in 0.838s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5f72f2d0-796d-4e77-89ad-8beea52aeb1a tempest-TaggedBootDevicesTest-1271091301 None] Lock "cinder-quobyte-c0a08afc-782f-44d0-875b-9f0bb7f55ee2" released by "delete_volume" :: held 2.671s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:14:42 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-5f72f2d0-796d-4e77-89ad-8beea52aeb1a tempest-TaggedBootDevicesTest-1271091301 None] Created reservations ['fdf06525-165b-44db-962d-096354d1f8d2', 'c983687e-00b9-455f-a88a-8b42caf02720', '7f42d08e-cd13-4f95-aadd-29069fc95a28', 'f71fa3b0-0cff-4a60-a47d-f3e7519d349f'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:14:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5f72f2d0-796d-4e77-89ad-8beea52aeb1a tempest-TaggedBootDevicesTest-1271091301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:14:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5f72f2d0-796d-4e77-89ad-8beea52aeb1a tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:14:42 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-5f72f2d0-796d-4e77-89ad-8beea52aeb1a tempest-TaggedBootDevicesTest-1271091301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:14:42 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-5f72f2d0-796d-4e77-89ad-8beea52aeb1a tempest-TaggedBootDevicesTest-1271091301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:14:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5f72f2d0-796d-4e77-89ad-8beea52aeb1a tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:14:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5f72f2d0-796d-4e77-89ad-8beea52aeb1a tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:42 devstack sudo[91869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:14:42 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9c3b8819-b688-4e04-90c1-2aaa252e41c7 tempest-TaggedBootDevicesTest-1271091301 None] Acquiring lock "cinder-8ba75bdc-8c93-41b9-a965-a73db0e30ecb-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:14:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9c3b8819-b688-4e04-90c1-2aaa252e41c7 tempest-TaggedBootDevicesTest-1271091301 None] Lock "cinder-8ba75bdc-8c93-41b9-a965-a73db0e30ecb-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:14:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9c3b8819-b688-4e04-90c1-2aaa252e41c7 tempest-TaggedBootDevicesTest-1271091301 None] Acquiring lock "cinder-quobyte-8ba75bdc-8c93-41b9-a965-a73db0e30ecb" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:14:43 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9c3b8819-b688-4e04-90c1-2aaa252e41c7 tempest-TaggedBootDevicesTest-1271091301 None] Lock "cinder-quobyte-8ba75bdc-8c93-41b9-a965-a73db0e30ecb" acquired by "delete_volume" :: waited 0.030s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:14:43 devstack cinder-volume[84547]: DEBUG cinder.image.glance [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] Creating Keystone auth plugin from conf {{(pid=84547) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 17:14:43 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b4c746-6e38-4bbd-bbaf-549b00486ecd]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:14:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9c3b8819-b688-4e04-90c1-2aaa252e41c7 tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8ba75bdc-8c93-41b9-a965-a73db0e30ecb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:43 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8ba75bdc-8c93-41b9-a965-a73db0e30ecb Apr 29 17:14:43 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:43 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5f72f2d0-796d-4e77-89ad-8beea52aeb1a tempest-TaggedBootDevicesTest-1271091301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.687s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:43 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-5f72f2d0-796d-4e77-89ad-8beea52aeb1a tempest-TaggedBootDevicesTest-1271091301 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:14:43 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-5f72f2d0-796d-4e77-89ad-8beea52aeb1a tempest-TaggedBootDevicesTest-1271091301 None] Deleted volume successfully. Apr 29 17:14:43 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5f72f2d0-796d-4e77-89ad-8beea52aeb1a tempest-TaggedBootDevicesTest-1271091301 None] Lock "cinder-c0a08afc-782f-44d0-875b-9f0bb7f55ee2-delete_volume" released by "delete_volume" :: held 4.705s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:14:44 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] Attempting download of 982d68c3-05b9-445d-85e5-5c92642a92aa ((None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}])) to volume f089b9c8-2829-47cb-94fa-ecaf54255f6a. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 17:14:44 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c284f3-01f1-4bb9-b797-10547c45448e]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:14:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rz47h0wd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:44 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rz47h0wd Apr 29 17:14:44 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:44 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9c3b8819-b688-4e04-90c1-2aaa252e41c7 tempest-TaggedBootDevicesTest-1271091301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8ba75bdc-8c93-41b9-a965-a73db0e30ecb" returned: 0 in 1.615s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9c3b8819-b688-4e04-90c1-2aaa252e41c7 tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8ba75bdc-8c93-41b9-a965-a73db0e30ecb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:44 devstack sudo[91977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8ba75bdc-8c93-41b9-a965-a73db0e30ecb Apr 29 17:14:44 devstack sudo[91977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:45 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rz47h0wd" returned: 0 in 1.154s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rz47h0wd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:45 devstack sudo[91983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rz47h0wd Apr 29 17:14:45 devstack sudo[91983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:45 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-51c892ce-e20e-4738-9c52-45d9469e9f5f tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Terminate volume connection completed successfully. Apr 29 17:14:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f26bbaf2-bf5c-49cd-a43d-ada8d883809c req-51c892ce-e20e-4738-9c52-45d9469e9f5f tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Deleting attachment e833bb77-bc1f-4eab-94cb-07733acf827d. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:14:45 devstack sudo[91977]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9c3b8819-b688-4e04-90c1-2aaa252e41c7 tempest-TaggedBootDevicesTest-1271091301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8ba75bdc-8c93-41b9-a965-a73db0e30ecb" returned: 0 in 1.025s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:45 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9c3b8819-b688-4e04-90c1-2aaa252e41c7 tempest-TaggedBootDevicesTest-1271091301 None] Lock "cinder-quobyte-8ba75bdc-8c93-41b9-a965-a73db0e30ecb" released by "delete_volume" :: held 2.748s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:14:45 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-9c3b8819-b688-4e04-90c1-2aaa252e41c7 tempest-TaggedBootDevicesTest-1271091301 None] Created reservations ['ec0caf0e-5791-4b79-9594-817440c69650', '12998468-9cad-4ecf-ba26-f1cb9a056e1a', 'a57327e5-848c-493f-a15e-477c48e34ac4', '8343d97d-9c14-46ba-9b7b-939951e86d25'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:14:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9c3b8819-b688-4e04-90c1-2aaa252e41c7 tempest-TaggedBootDevicesTest-1271091301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:14:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9c3b8819-b688-4e04-90c1-2aaa252e41c7 tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:14:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9c3b8819-b688-4e04-90c1-2aaa252e41c7 tempest-TaggedBootDevicesTest-1271091301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:14:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9c3b8819-b688-4e04-90c1-2aaa252e41c7 tempest-TaggedBootDevicesTest-1271091301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:14:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9c3b8819-b688-4e04-90c1-2aaa252e41c7 tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:14:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9c3b8819-b688-4e04-90c1-2aaa252e41c7 tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:45 devstack sudo[91988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:14:45 devstack sudo[91988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] Acquiring lock "cinder-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:14:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] Lock "cinder-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:14:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] Acquiring lock "cinder-quobyte-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:14:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] Lock "cinder-quobyte-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb" acquired by "delete_volume" :: waited 0.027s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:14:46 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[7218801c-26cb-4a81-9871-52ae940a6b15]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:14:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:46 devstack sudo[91983]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rz47h0wd" returned: 1 in 1.323s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rz47h0wd' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:14:46 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb Apr 29 17:14:46 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:47 devstack sudo[91988]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9c3b8819-b688-4e04-90c1-2aaa252e41c7 tempest-TaggedBootDevicesTest-1271091301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.504s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:47 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-9c3b8819-b688-4e04-90c1-2aaa252e41c7 tempest-TaggedBootDevicesTest-1271091301 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:14:47 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-9c3b8819-b688-4e04-90c1-2aaa252e41c7 tempest-TaggedBootDevicesTest-1271091301 None] Deleted volume successfully. Apr 29 17:14:47 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9c3b8819-b688-4e04-90c1-2aaa252e41c7 tempest-TaggedBootDevicesTest-1271091301 None] Lock "cinder-8ba75bdc-8c93-41b9-a965-a73db0e30ecb-delete_volume" released by "delete_volume" :: held 4.649s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:14:47 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rz47h0wd, size 20.69 MB, duration 1.11 sec {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 17:14:47 devstack cinder-volume[84547]: INFO cinder.image.image_utils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] Image download 20.69 MB at 18.60 MB/s Apr 29 17:14:47 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7edb53e-8a3c-4e8f-8841-79dbabeac32d]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:14:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rz47h0wd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:47 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:14:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Flow 'volume_create_manager' (fde3c006-a72b-4db5-bfc4-ebb378ab3159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:14:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc700d32-1f2c-4643-877b-17f717fbe802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:14:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc700d32-1f2c-4643-877b-17f717fbe802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1354173030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c45d897-f210-4fe1-9f08-89a4bebe8f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='973d10520e8b4de493f2bc87ca1c5575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:14:48Z,use_quota=True,user_id='4d8f41f5db9a4d21bb777decd858b6db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:14:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c9c922-3390-435b-998d-a98e5a8485d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:14:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c9c922-3390-435b-998d-a98e5a8485d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:14:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8d1f2e-0767-427a-beb0-d2f8b96b9d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:14:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d8d1f2e-0767-427a-beb0-d2f8b96b9d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c45d897-f210-4fe1-9f08-89a4bebe8f02', 'volume_name': 'volume-3c45d897-f210-4fe1-9f08-89a4bebe8f02', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:14:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3dac2ec-6fba-42fb-b175-56adef9db830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:14:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3dac2ec-6fba-42fb-b175-56adef9db830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:14:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa68fdc-b707-4823-adcf-de2af8c2d0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:14:48 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Volume 3c45d897-f210-4fe1-9f08-89a4bebe8f02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c45d897-f210-4fe1-9f08-89a4bebe8f02', 'volume_size': 1} Apr 29 17:14:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:14:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:14:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1354173030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c45d897-f210-4fe1-9f08-89a4bebe8f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='973d10520e8b4de493f2bc87ca1c5575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:14:48Z,use_quota=True,user_id='4d8f41f5db9a4d21bb777decd858b6db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:14:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Creating volume 3c45d897-f210-4fe1-9f08-89a4bebe8f02 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:14:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:14:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:14:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:14:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:14:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:14:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:14:48 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:14:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c45d897-f210-4fe1-9f08-89a4bebe8f02 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:48 devstack sudo[92006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c45d897-f210-4fe1-9f08-89a4bebe8f02 1073741824 Apr 29 17:14:48 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:48 devstack sudo[91997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rz47h0wd Apr 29 17:14:48 devstack sudo[91997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:48 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb" returned: 0 in 1.838s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:48 devstack sudo[92037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb Apr 29 17:14:48 devstack sudo[92037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:49 devstack sudo[91997]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rz47h0wd" returned: 0 in 1.187s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:49 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] 982d68c3-05b9-445d-85e5-5c92642a92aa was qcow2, converting to raw {{(pid=84547) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 17:14:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -S 0 -f qcow2 /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rz47h0wd /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:49 devstack sudo[92046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -S 0 -f qcow2 /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rz47h0wd /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a Apr 29 17:14:49 devstack sudo[92046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:49 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c45d897-f210-4fe1-9f08-89a4bebe8f02 1073741824" returned: 0 in 1.585s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c45d897-f210-4fe1-9f08-89a4bebe8f02 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:49 devstack sudo[92052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c45d897-f210-4fe1-9f08-89a4bebe8f02 Apr 29 17:14:49 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:49 devstack sudo[92037]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb" returned: 1 in 1.389s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:14:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:49 devstack sudo[92055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb Apr 29 17:14:49 devstack sudo[92055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:50 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c45d897-f210-4fe1-9f08-89a4bebe8f02" returned: 0 in 1.029s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] <== create_volume: return (2711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:14:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.719s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:14:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfa68fdc-b707-4823-adcf-de2af8c2d0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c45d897-f210-4fe1-9f08-89a4bebe8f02', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:14:50 devstack sudo[92055]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36c3d1e-c619-4112-b189-8c61a7590e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:14:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb" returned: 0 in 0.882s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:50 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] Lock "cinder-quobyte-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb" released by "delete_volume" :: held 4.257s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:14:50 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Volume volume-3c45d897-f210-4fe1-9f08-89a4bebe8f02 (3c45d897-f210-4fe1-9f08-89a4bebe8f02): created successfully Apr 29 17:14:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b36c3d1e-c619-4112-b189-8c61a7590e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:14:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Flow 'volume_create_manager' (fde3c006-a72b-4db5-bfc4-ebb378ab3159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:14:50 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-35d09c2b-bea6-4fbc-a382-f147bf2f211c tempest-ServerRescueNegativeTestJSON-1326654837 None] Created volume successfully. Apr 29 17:14:50 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] Created reservations ['efbf0cb4-187c-4166-9883-7b0f3f32a40b', '8b5ae598-7d6b-4f1f-95cb-0e01a0311bec', 'a4925b23-0f6b-43f0-a0da-5b1bcd0cdb1b', '2fc55adc-a36f-4ea3-aba0-28f24f8068be'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:14:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:14:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:14:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:14:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:14:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:14:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:51 devstack sudo[92065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:14:51 devstack sudo[92065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:52 devstack sudo[92065]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.271s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:52 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:14:52 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] Deleted volume successfully. Apr 29 17:14:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ca70983b-6195-476d-9e1c-78fd1ab035cb tempest-TaggedBootDevicesTest-1271091301 None] Lock "cinder-8edc886b-6920-4dcf-ae8c-dfa2ec00dffb-delete_volume" released by "delete_volume" :: held 5.921s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:14:53 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-8fd9dc8a-53bf-45ad-b774-57e5b706ee80 req-1dd5c016-e276-4c23-9154-666c56a3d827 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Acquiring lock "cinder-bdce866c-7f85-4f3b-9b85-36c04bb0482e-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:14:53 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-8fd9dc8a-53bf-45ad-b774-57e5b706ee80 req-1dd5c016-e276-4c23-9154-666c56a3d827 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "cinder-bdce866c-7f85-4f3b-9b85-36c04bb0482e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:14:53 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-8fd9dc8a-53bf-45ad-b774-57e5b706ee80 req-1dd5c016-e276-4c23-9154-666c56a3d827 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Acquiring lock "cinder-quobyte-bdce866c-7f85-4f3b-9b85-36c04bb0482e" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:14:53 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-8fd9dc8a-53bf-45ad-b774-57e5b706ee80 req-1dd5c016-e276-4c23-9154-666c56a3d827 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "cinder-quobyte-bdce866c-7f85-4f3b-9b85-36c04bb0482e" acquired by "delete_volume" :: waited 0.032s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:14:53 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b569e0-0510-4cd4-90e8-4a53660e928f]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:14:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-8fd9dc8a-53bf-45ad-b774-57e5b706ee80 req-1dd5c016-e276-4c23-9154-666c56a3d827 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bdce866c-7f85-4f3b-9b85-36c04bb0482e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:54 devstack sudo[92068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bdce866c-7f85-4f3b-9b85-36c04bb0482e Apr 29 17:14:54 devstack sudo[92068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:55 devstack sudo[92046]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -S 0 -f qcow2 /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rz47h0wd /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a" returned: 0 in 6.083s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:55 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rz47h0wd, size 112.00 MB, duration 6.09 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:14:55 devstack cinder-volume[84547]: INFO cinder.image.image_utils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] Converted 112.00 MB image at 18.40 MB/s Apr 29 17:14:55 devstack sudo[92068]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-8fd9dc8a-53bf-45ad-b774-57e5b706ee80 req-1dd5c016-e276-4c23-9154-666c56a3d827 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bdce866c-7f85-4f3b-9b85-36c04bb0482e" returned: 0 in 1.222s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-8fd9dc8a-53bf-45ad-b774-57e5b706ee80 req-1dd5c016-e276-4c23-9154-666c56a3d827 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bdce866c-7f85-4f3b-9b85-36c04bb0482e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:55 devstack sudo[92075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a 1G Apr 29 17:14:55 devstack sudo[92075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:55 devstack sudo[92076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bdce866c-7f85-4f3b-9b85-36c04bb0482e Apr 29 17:14:55 devstack sudo[92076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:56 devstack sudo[92076]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-8fd9dc8a-53bf-45ad-b774-57e5b706ee80 req-1dd5c016-e276-4c23-9154-666c56a3d827 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bdce866c-7f85-4f3b-9b85-36c04bb0482e" returned: 0 in 1.200s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-8fd9dc8a-53bf-45ad-b774-57e5b706ee80 req-1dd5c016-e276-4c23-9154-666c56a3d827 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "cinder-quobyte-bdce866c-7f85-4f3b-9b85-36c04bb0482e" released by "delete_volume" :: held 2.555s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:14:56 devstack cinder-volume[84547]: DEBUG cinder.quota [req-8fd9dc8a-53bf-45ad-b774-57e5b706ee80 req-1dd5c016-e276-4c23-9154-666c56a3d827 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Created reservations ['78c56084-be0c-4c2f-b034-2c3cd7cdbcdd', '8a457df9-4f64-41e3-bcaf-929bbed2b78f', '041eb0db-dbaa-432b-b899-1f4e36bc022e', '4a58ba39-6be1-4484-9cec-4a47b8dd8994'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:14:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-8fd9dc8a-53bf-45ad-b774-57e5b706ee80 req-1dd5c016-e276-4c23-9154-666c56a3d827 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:14:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-8fd9dc8a-53bf-45ad-b774-57e5b706ee80 req-1dd5c016-e276-4c23-9154-666c56a3d827 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:14:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-8fd9dc8a-53bf-45ad-b774-57e5b706ee80 req-1dd5c016-e276-4c23-9154-666c56a3d827 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:14:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-8fd9dc8a-53bf-45ad-b774-57e5b706ee80 req-1dd5c016-e276-4c23-9154-666c56a3d827 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:14:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-8fd9dc8a-53bf-45ad-b774-57e5b706ee80 req-1dd5c016-e276-4c23-9154-666c56a3d827 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:14:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-8fd9dc8a-53bf-45ad-b774-57e5b706ee80 req-1dd5c016-e276-4c23-9154-666c56a3d827 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:56 devstack sudo[92086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:14:56 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:56 devstack sudo[92075]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a 1G" returned: 0 in 1.704s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:56 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[044d4a37-07df-4406-a740-dd972deea21f]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:14:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:57 devstack sudo[92088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a Apr 29 17:14:57 devstack sudo[92088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:58 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-8fd9dc8a-53bf-45ad-b774-57e5b706ee80 req-1dd5c016-e276-4c23-9154-666c56a3d827 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.380s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:58 devstack cinder-volume[84547]: DEBUG cinder.manager [req-8fd9dc8a-53bf-45ad-b774-57e5b706ee80 req-1dd5c016-e276-4c23-9154-666c56a3d827 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:14:58 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-8fd9dc8a-53bf-45ad-b774-57e5b706ee80 req-1dd5c016-e276-4c23-9154-666c56a3d827 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Deleted volume successfully. Apr 29 17:14:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-8fd9dc8a-53bf-45ad-b774-57e5b706ee80 req-1dd5c016-e276-4c23-9154-666c56a3d827 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "cinder-bdce866c-7f85-4f3b-9b85-36c04bb0482e-delete_volume" released by "delete_volume" :: held 4.460s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:14:58 devstack sudo[92088]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a" returned: 0 in 1.568s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:14:58 devstack sudo[92118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a Apr 29 17:14:58 devstack sudo[92118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:14:59 devstack sudo[92118]: pam_unix(sudo:session): session closed for user root Apr 29 17:14:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a" returned: 1 in 1.202s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:14:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:14:59 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] Downloaded image 982d68c3-05b9-445d-85e5-5c92642a92aa ((None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}])) to volume f089b9c8-2829-47cb-94fa-ecaf54255f6a successfully. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 17:14:59 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] Marking volume f089b9c8-2829-47cb-94fa-ecaf54255f6a as bootable. {{(pid=84547) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 17:14:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] Creating volume glance metadata for volume f089b9c8-2829-47cb-94fa-ecaf54255f6a backed by image 982d68c3-05b9-445d-85e5-5c92642a92aa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84547) _refresh_volume_glance_meta /opt/stack/cinder/cinder/volume/manager.py:5408}} Apr 29 17:14:59 devstack cinder-volume[84547]: DEBUG cinder.compute.nova [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] Creating Keystone auth plugin from conf {{(pid=84547) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Apr 29 17:15:00 devstack cinder-volume[84547]: DEBUG novaclient.v2.client [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] REQ: curl -g -i -X POST http://192.168.122.196/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "OpenStack-API-Version: compute 2.93" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a734aea9d209d7274f5d8b96e23b9b60b8e80756b73bb65f85e98131d6e6a6fd" -H "X-OpenStack-Nova-API-Version: 2.93" -H "X-OpenStack-Request-ID: req-5df388d2-e676-48c0-82ff-779091b42293" -H "X-Service-Token: {SHA256}3a79b46e8894ff100925c1344ccee3fbb286073638f3c6000328add7c1c7ce09" -d '{"events": [{"name": "volume-reimaged", "server_uuid": "f282adf3-66b1-45b8-94a3-3df53bea9c8f", "tag": "f089b9c8-2829-47cb-94fa-ecaf54255f6a"}]}' {{(pid=84547) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Apr 29 17:15:00 devstack cinder-volume[84547]: DEBUG novaclient.v2.client [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Wed, 29 Apr 2026 15:15:00 GMT OpenStack-API-Version: compute 2.93 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.93 x-compute-request-id: req-fa791b53-befe-428d-92f2-757000dd2e21 x-openstack-request-id: req-fa791b53-befe-428d-92f2-757000dd2e21 {{(pid=84547) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Apr 29 17:15:00 devstack cinder-volume[84547]: DEBUG novaclient.v2.client [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] RESP BODY: {"events": [{"name": "volume-reimaged", "server_uuid": "f282adf3-66b1-45b8-94a3-3df53bea9c8f", "tag": "f089b9c8-2829-47cb-94fa-ecaf54255f6a", "status": "completed", "code": 200}]} {{(pid=84547) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Apr 29 17:15:00 devstack cinder-volume[84547]: DEBUG novaclient.v2.client [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] POST call to compute for http://192.168.122.196/compute/v2.1/os-server-external-events used request id req-fa791b53-befe-428d-92f2-757000dd2e21 {{(pid=84547) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Apr 29 17:15:00 devstack cinder-volume[84547]: INFO cinder.compute.nova [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] Nova event response: {'name': 'volume-reimaged', 'server_uuid': 'f282adf3-66b1-45b8-94a3-3df53bea9c8f', 'tag': 'f089b9c8-2829-47cb-94fa-ecaf54255f6a', 'status': 'completed', 'code': 200}. Apr 29 17:15:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-5df388d2-e676-48c0-82ff-779091b42293 req-6ec4a924-cf5e-4c4a-9e57-6bb69ce8ad27 tempest-ServerActionsV293TestJSON-1455016196 None] Re-imaged 982d68c3-05b9-445d-85e5-5c92642a92aa to volume f089b9c8-2829-47cb-94fa-ecaf54255f6a successfully. {{(pid=84547) reimage /opt/stack/cinder/cinder/volume/manager.py:5451}} Apr 29 17:15:01 devstack cinder-volume[84547]: DEBUG oslo_db.sqlalchemy.engines [req-5df388d2-e676-48c0-82ff-779091b42293 req-b559767f-dad2-463c-a15c-99a842160ba1 tempest-ServerActionsV293TestJSON-1455016196 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84547) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 17:15:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-b559767f-dad2-463c-a15c-99a842160ba1 tempest-ServerActionsV293TestJSON-1455016196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:15:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-b559767f-dad2-463c-a15c-99a842160ba1 tempest-ServerActionsV293TestJSON-1455016196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:15:01 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[56875182-6348-43c9-acd3-52bcd7461363]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:15:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-b559767f-dad2-463c-a15c-99a842160ba1 tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:15:01 devstack sudo[92149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a Apr 29 17:15:01 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:15:02 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root Apr 29 17:15:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-b559767f-dad2-463c-a15c-99a842160ba1 tempest-ServerActionsV293TestJSON-1455016196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a" returned: 0 in 0.784s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:15:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-b559767f-dad2-463c-a15c-99a842160ba1 tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:15:02 devstack sudo[92155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a Apr 29 17:15:02 devstack sudo[92155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:15:02 devstack sudo[92155]: pam_unix(sudo:session): session closed for user root Apr 29 17:15:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-b559767f-dad2-463c-a15c-99a842160ba1 tempest-ServerActionsV293TestJSON-1455016196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a" returned: 1 in 0.903s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:15:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-b559767f-dad2-463c-a15c-99a842160ba1 tempest-ServerActionsV293TestJSON-1455016196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:15:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-5df388d2-e676-48c0-82ff-779091b42293 req-b559767f-dad2-463c-a15c-99a842160ba1 tempest-ServerActionsV293TestJSON-1455016196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.731s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:15:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-5df388d2-e676-48c0-82ff-779091b42293 req-b559767f-dad2-463c-a15c-99a842160ba1 tempest-ServerActionsV293TestJSON-1455016196 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63e17881-2c44-4d80-925b-d3078cbdc761', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:15:03 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-5df388d2-e676-48c0-82ff-779091b42293 req-b559767f-dad2-463c-a15c-99a842160ba1 tempest-ServerActionsV293TestJSON-1455016196 None] attachment_update completed successfully. Apr 29 17:15:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:15:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:15:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:15:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:15:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:15:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:15:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:15:05 devstack sudo[92182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:15:05 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:15:06 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root Apr 29 17:15:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.187s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:15:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:15:13 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=37,cinder:SELECT=50,cinder:INSERT=16,cinder:DELETE=6 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:15:13 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=47,cinder:UPDATE=54,cinder:INSERT=15,cinder:DELETE=1 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:15:41 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:15:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Flow 'volume_create_manager' (8fbc90cc-2594-4454-986a-224e9aa76937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:15:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974c083b-4a63-476f-9060-e9d1cb2e3631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:15:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974c083b-4a63-476f-9060-e9d1cb2e3631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:15:41Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985580e2-7663-4006-9f80-542a412809bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abbf47527e4b4d79b618a1bb00dcdf74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:15:41Z,use_quota=True,user_id='5db80bb202c04267838b9cb45296e5c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:15:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f635301d-abcf-456a-8afb-dc917e1e5213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:15:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f635301d-abcf-456a-8afb-dc917e1e5213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:15:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7952bbf-7bc6-4796-af01-269d793f28aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:15:41 devstack cinder-volume[84547]: DEBUG cinder.image.glance [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Creating Keystone auth plugin from conf {{(pid=84547) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 17:15:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7952bbf-7bc6-4796-af01-269d793f28aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '985580e2-7663-4006-9f80-542a412809bd', 'volume_name': 'volume-985580e2-7663-4006-9f80-542a412809bd', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:15:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed0fadc-a8de-44d0-9a96-0150202ce5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:15:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed0fadc-a8de-44d0-9a96-0150202ce5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:15:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b0722f-a712-4d30-97d4-d6024bbff1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:15:41 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Volume 985580e2-7663-4006-9f80-542a412809bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-985580e2-7663-4006-9f80-542a412809bd', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 17:15:41 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Trying to clone 985580e2-7663-4006-9f80-542a412809bd from image 982d68c3-05b9-445d-85e5-5c92642a92aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]). {{(pid=84547) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 17:15:42 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_md1unc8udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 17:15:42 devstack cinder-volume[84547]: INFO cinder.image.image_utils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Image download 20.69 MB at 20.69 MB/s Apr 29 17:15:42 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d837ec-c176-4434-9441-ff023b216fa8]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:15:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_md1unc8udevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:15:42 devstack sudo[92897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_md1unc8udevstack@QuobyteHD Apr 29 17:15:42 devstack sudo[92897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:15:44 devstack sudo[92897]: pam_unix(sudo:session): session closed for user root Apr 29 17:15:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_md1unc8udevstack@QuobyteHD" returned: 0 in 1.406s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:15:44 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Temporary image 982d68c3-05b9-445d-85e5-5c92642a92aa is fetched for user 5db80bb202c04267838b9cb45296e5c1. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 17:15:44 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[40681ef7-cf06-43a2-9a38-84cb165dd166]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:15:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_md1unc8udevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:15:44 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_md1unc8udevstack@QuobyteHD Apr 29 17:15:44 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:15:45 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Apr 29 17:15:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_md1unc8udevstack@QuobyteHD" returned: 0 in 1.128s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:15:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:15:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:15:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:15:41Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=985580e2-7663-4006-9f80-542a412809bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='abbf47527e4b4d79b618a1bb00dcdf74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:15:41Z,use_quota=True,user_id='5db80bb202c04267838b9cb45296e5c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:15:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Creating volume 985580e2-7663-4006-9f80-542a412809bd {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:15:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:15:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:15:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:15:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:15:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:15:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:15:45 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:15:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:15:45 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd 1073741824 Apr 29 17:15:45 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:15:46 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Apr 29 17:15:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd 1073741824" returned: 0 in 0.836s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:15:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:15:46 devstack sudo[92932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd Apr 29 17:15:46 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:15:46 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root Apr 29 17:15:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd" returned: 0 in 0.694s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:15:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:15:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:15:46 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Attempting download of 982d68c3-05b9-445d-85e5-5c92642a92aa ((None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}])) to volume 985580e2-7663-4006-9f80-542a412809bd. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 17:15:47 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c59de1-4e81-4999-b265-207f8f8663fe]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:15:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_041d_2n1 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:15:47 devstack sudo[92937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_041d_2n1 Apr 29 17:15:47 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:15:47 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root Apr 29 17:15:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_041d_2n1" returned: 0 in 0.694s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:15:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_041d_2n1 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:15:47 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_041d_2n1 Apr 29 17:15:47 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:15:48 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Apr 29 17:15:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_041d_2n1" returned: 1 in 0.682s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:15:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_041d_2n1' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:15:48 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a12fa51-2ba5-4ed0-a833-2d524af36322]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:15:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_md1unc8udevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:15:48 devstack sudo[92945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_md1unc8udevstack@QuobyteHD Apr 29 17:15:48 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:15:49 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root Apr 29 17:15:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_md1unc8udevstack@QuobyteHD" returned: 0 in 0.702s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:15:49 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] 982d68c3-05b9-445d-85e5-5c92642a92aa was qcow2, converting to raw {{(pid=84547) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 17:15:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_md1unc8udevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:15:49 devstack sudo[92953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_md1unc8udevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd Apr 29 17:15:49 devstack sudo[92953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:15:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-263f5760-fbc8-48b0-9179-4aa00599dbfb req-01aab9db-e4f9-4b5f-920d-babf1b03de27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:15:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-263f5760-fbc8-48b0-9179-4aa00599dbfb req-01aab9db-e4f9-4b5f-920d-babf1b03de27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:15:50 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec0e7cc-84bc-4063-b419-4bd88e791c8b]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:15:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-263f5760-fbc8-48b0-9179-4aa00599dbfb req-01aab9db-e4f9-4b5f-920d-babf1b03de27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c45d897-f210-4fe1-9f08-89a4bebe8f02 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:15:50 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c45d897-f210-4fe1-9f08-89a4bebe8f02 Apr 29 17:15:50 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:15:52 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Apr 29 17:15:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-263f5760-fbc8-48b0-9179-4aa00599dbfb req-01aab9db-e4f9-4b5f-920d-babf1b03de27 tempest-ServerRescueNegativeTestJSON-1326654837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c45d897-f210-4fe1-9f08-89a4bebe8f02" returned: 0 in 1.642s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:15:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-263f5760-fbc8-48b0-9179-4aa00599dbfb req-01aab9db-e4f9-4b5f-920d-babf1b03de27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.664s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:15:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-263f5760-fbc8-48b0-9179-4aa00599dbfb req-01aab9db-e4f9-4b5f-920d-babf1b03de27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-3c45d897-f210-4fe1-9f08-89a4bebe8f02', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3121aa34-1a18-4aea-9ed7-a9e70da2b5bf', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:15:52 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-263f5760-fbc8-48b0-9179-4aa00599dbfb req-01aab9db-e4f9-4b5f-920d-babf1b03de27 tempest-ServerRescueNegativeTestJSON-1326654837 None] attachment_update completed successfully. Apr 29 17:15:52 devstack sudo[92953]: pam_unix(sudo:session): session closed for user root Apr 29 17:15:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_md1unc8udevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd" returned: 0 in 3.119s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:15:52 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_md1unc8udevstack@QuobyteHD, size 112.00 MB, duration 3.12 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:15:52 devstack cinder-volume[84547]: INFO cinder.image.image_utils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Converted 112.00 MB image at 35.89 MB/s Apr 29 17:15:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:15:52 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd 1G Apr 29 17:15:52 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:15:53 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-263f5760-fbc8-48b0-9179-4aa00599dbfb req-2507707e-5532-4a91-bf3d-0489937ff0ad tempest-ServerRescueNegativeTestJSON-1326654837 None] Terminate volume connection completed successfully. Apr 29 17:15:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-263f5760-fbc8-48b0-9179-4aa00599dbfb req-2507707e-5532-4a91-bf3d-0489937ff0ad tempest-ServerRescueNegativeTestJSON-1326654837 None] Deleting attachment 3121aa34-1a18-4aea-9ed7-a9e70da2b5bf. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:15:53 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Apr 29 17:15:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd 1G" returned: 0 in 1.249s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:15:53 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[967d4bee-40a9-44c4-840e-937c50b36e73]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:15:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:15:53 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd Apr 29 17:15:53 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:15:54 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Apr 29 17:15:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd" returned: 0 in 1.405s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:15:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:15:55 devstack sudo[93128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd Apr 29 17:15:55 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:15:56 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-47da7dc9-1e6b-4033-83e9-79a67d12bed3 tempest-ServerActionsV293TestJSON-1455016196 None] Terminate volume connection completed successfully. Apr 29 17:15:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-47da7dc9-1e6b-4033-83e9-79a67d12bed3 tempest-ServerActionsV293TestJSON-1455016196 None] Deleting attachment 63e17881-2c44-4d80-925b-d3078cbdc761. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:15:56 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root Apr 29 17:15:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd" returned: 1 in 1.153s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:15:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:15:56 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Downloaded image 982d68c3-05b9-445d-85e5-5c92642a92aa ((None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}])) to volume 985580e2-7663-4006-9f80-542a412809bd successfully. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 17:15:56 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Temporary image 982d68c3-05b9-445d-85e5-5c92642a92aa for user 5db80bb202c04267838b9cb45296e5c1 is deleted. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 17:15:56 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Marking volume 985580e2-7663-4006-9f80-542a412809bd as bootable. {{(pid=84547) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 17:15:56 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Copying metadata from image 982d68c3-05b9-445d-85e5-5c92642a92aa to 985580e2-7663-4006-9f80-542a412809bd. {{(pid=84547) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 17:15:56 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Creating volume glance metadata for volume 985580e2-7663-4006-9f80-542a412809bd backed by image 982d68c3-05b9-445d-85e5-5c92642a92aa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84547) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 17:15:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b0722f-a712-4d30-97d4-d6024bbff1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-985580e2-7663-4006-9f80-542a412809bd', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:15:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0fd3da-3abd-4df6-8718-1e5c65ad6ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:15:56 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Volume volume-985580e2-7663-4006-9f80-542a412809bd (985580e2-7663-4006-9f80-542a412809bd): created successfully Apr 29 17:15:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0fd3da-3abd-4df6-8718-1e5c65ad6ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:15:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Flow 'volume_create_manager' (8fbc90cc-2594-4454-986a-224e9aa76937) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:15:56 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-26c7aeac-8fae-4f04-a8b2-071bd6af288d tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Created volume successfully. Apr 29 17:15:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] Acquiring lock "cinder-f089b9c8-2829-47cb-94fa-ecaf54255f6a-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:15:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] Lock "cinder-f089b9c8-2829-47cb-94fa-ecaf54255f6a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:15:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] Acquiring lock "cinder-quobyte-f089b9c8-2829-47cb-94fa-ecaf54255f6a" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:15:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] Lock "cinder-quobyte-f089b9c8-2829-47cb-94fa-ecaf54255f6a" acquired by "delete_volume" :: waited 0.032s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:15:56 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5acda59-3afd-4e7b-89d1-973f6aa3b7af]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:15:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:15:57 devstack sudo[93168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a Apr 29 17:15:57 devstack sudo[93168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:15:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-9f3d2a62-e675-4def-8fd1-1942859249b6 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:15:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-9f3d2a62-e675-4def-8fd1-1942859249b6 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:15:57 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94c2582-746e-4d1b-b2e1-95459ce955b9]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:15:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-9f3d2a62-e675-4def-8fd1-1942859249b6 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:15:58 devstack sudo[93168]: pam_unix(sudo:session): session closed for user root Apr 29 17:15:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a" returned: 0 in 1.188s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:15:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:15:58 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd Apr 29 17:15:58 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:15:58 devstack sudo[93203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a Apr 29 17:15:58 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:15:59 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Apr 29 17:15:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-9f3d2a62-e675-4def-8fd1-1942859249b6 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd" returned: 0 in 1.083s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:15:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-9f3d2a62-e675-4def-8fd1-1942859249b6 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:15:59 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd Apr 29 17:15:59 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:15:59 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root Apr 29 17:15:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a" returned: 1 in 1.246s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:15:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:15:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:15:59 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a Apr 29 17:15:59 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:00 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-9f3d2a62-e675-4def-8fd1-1942859249b6 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd" returned: 1 in 1.218s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-9f3d2a62-e675-4def-8fd1-1942859249b6 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:16:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-9f3d2a62-e675-4def-8fd1-1942859249b6 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.356s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-9f3d2a62-e675-4def-8fd1-1942859249b6 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-985580e2-7663-4006-9f80-542a412809bd', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dce504a4-f2ce-47a0-8e63-3161d58a9081', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:16:00 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f089b9c8-2829-47cb-94fa-ecaf54255f6a" returned: 0 in 1.114s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:00 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-57fc400d-0aa5-4e61-b2c2-9fdce236c705 req-9f3d2a62-e675-4def-8fd1-1942859249b6 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] attachment_update completed successfully. Apr 29 17:16:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] Lock "cinder-quobyte-f089b9c8-2829-47cb-94fa-ecaf54255f6a" released by "delete_volume" :: held 3.644s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:16:00 devstack cinder-volume[84547]: DEBUG cinder.quota [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] Created reservations ['f2bc6dd6-85e3-4b8c-8d2c-7c2386308fcd', 'ba162c34-8c15-42dc-ad53-fb2699c97631', '8c82a4d0-4380-4105-bf7f-0d669e97423e', '0fa4ed93-b590-4203-b233-59828c5ceb9b'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:16:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:16:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:16:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:00 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:16:00 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:01 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.685s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:01 devstack cinder-volume[84547]: DEBUG cinder.manager [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:16:01 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] Deleted volume successfully. Apr 29 17:16:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-e9bd6525-e3b9-4200-b1c9-79f7a9c5d50a req-fd350305-fdce-45ed-a083-27b924be5062 tempest-ServerActionsV293TestJSON-1455016196 None] Lock "cinder-f089b9c8-2829-47cb-94fa-ecaf54255f6a-delete_volume" released by "delete_volume" :: held 4.573s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:16:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:16:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:16:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:16:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:05 devstack sudo[93326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:16:05 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:06 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.986s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:16:10 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=32,cinder:INSERT=8,cinder:UPDATE=11 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:16:10 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:16:10 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Flow 'volume_create_manager' (3a6a3a36-f682-453c-a602-3d33b21cd0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:16:10 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d03b87-1700-4e95-acd2-494f9d4a95ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d03b87-1700-4e95-acd2-494f9d4a95ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-351954472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c70efd7-a343-4307-bb42-d0af462da90e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a3c33b8d1c3648f6aabba3fab4787b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:16:11Z,use_quota=True,user_id='5917fedb03e84f57aeec84598a88a278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df84cc0-01f1-4aa9-930b-ecfbbbf83f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df84cc0-01f1-4aa9-930b-ecfbbbf83f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442b5a5f-0e80-451e-89df-758a5c5f50c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442b5a5f-0e80-451e-89df-758a5c5f50c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c70efd7-a343-4307-bb42-d0af462da90e', 'volume_name': 'volume-8c70efd7-a343-4307-bb42-d0af462da90e', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c97bcbab-cedc-4306-aab5-53468d4d13f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c97bcbab-cedc-4306-aab5-53468d4d13f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781c1018-7b2c-4df8-bd09-d5efcff5d282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:11 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Volume 8c70efd7-a343-4307-bb42-d0af462da90e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c70efd7-a343-4307-bb42-d0af462da90e', 'volume_size': 1} Apr 29 17:16:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-351954472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c70efd7-a343-4307-bb42-d0af462da90e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a3c33b8d1c3648f6aabba3fab4787b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:16:11Z,use_quota=True,user_id='5917fedb03e84f57aeec84598a88a278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:16:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Creating volume 8c70efd7-a343-4307-bb42-d0af462da90e {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:16:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:16:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:16:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:16:11 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:16:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8c70efd7-a343-4307-bb42-d0af462da90e 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:11 devstack sudo[93682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8c70efd7-a343-4307-bb42-d0af462da90e 1073741824 Apr 29 17:16:11 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:12 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8c70efd7-a343-4307-bb42-d0af462da90e 1073741824" returned: 0 in 1.032s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8c70efd7-a343-4307-bb42-d0af462da90e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:12 devstack sudo[93687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8c70efd7-a343-4307-bb42-d0af462da90e Apr 29 17:16:12 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:13 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8c70efd7-a343-4307-bb42-d0af462da90e" returned: 0 in 0.822s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:16:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.938s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (781c1018-7b2c-4df8-bd09-d5efcff5d282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c70efd7-a343-4307-bb42-d0af462da90e', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e4f9cc-e598-434e-95cd-21b001f252df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:13 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Volume volume-8c70efd7-a343-4307-bb42-d0af462da90e (8c70efd7-a343-4307-bb42-d0af462da90e): created successfully Apr 29 17:16:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e4f9cc-e598-434e-95cd-21b001f252df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Flow 'volume_create_manager' (3a6a3a36-f682-453c-a602-3d33b21cd0d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:16:13 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-8a78a2a8-278d-43a2-a31b-edb7bcc7b0dd tempest-VolumesTestJSON-1358224619 None] Created volume successfully. Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Flow 'volume_create_manager' (516eeea6-0eb5-4747-9038-3701d2d90152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d778ee9-d8b2-4a7f-82b9-7b171ae41415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d778ee9-d8b2-4a7f-82b9-7b171ae41415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-918547890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df16232b-c7bd-4a26-acce-a5afafb6fbf5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a3c33b8d1c3648f6aabba3fab4787b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:16:15Z,use_quota=True,user_id='5917fedb03e84f57aeec84598a88a278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93482c28-6f44-4362-9d89-aa9b7e86a26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93482c28-6f44-4362-9d89-aa9b7e86a26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2307ff01-dca0-4cf0-9203-c60e5222061d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2307ff01-dca0-4cf0-9203-c60e5222061d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df16232b-c7bd-4a26-acce-a5afafb6fbf5', 'volume_name': 'volume-df16232b-c7bd-4a26-acce-a5afafb6fbf5', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dea9270-1761-4881-a7fd-3fa59a0f653b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dea9270-1761-4881-a7fd-3fa59a0f653b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78297535-1a4c-4264-97c0-c2b3ea8e134e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:14 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Volume df16232b-c7bd-4a26-acce-a5afafb6fbf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df16232b-c7bd-4a26-acce-a5afafb6fbf5', 'volume_size': 1} Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-918547890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df16232b-c7bd-4a26-acce-a5afafb6fbf5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a3c33b8d1c3648f6aabba3fab4787b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:16:15Z,use_quota=True,user_id='5917fedb03e84f57aeec84598a88a278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Creating volume df16232b-c7bd-4a26-acce-a5afafb6fbf5 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:16:14 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:16:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-df16232b-c7bd-4a26-acce-a5afafb6fbf5 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:14 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-df16232b-c7bd-4a26-acce-a5afafb6fbf5 1073741824 Apr 29 17:16:14 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:15 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-df16232b-c7bd-4a26-acce-a5afafb6fbf5 1073741824" returned: 0 in 0.894s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-df16232b-c7bd-4a26-acce-a5afafb6fbf5 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:15 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-df16232b-c7bd-4a26-acce-a5afafb6fbf5 Apr 29 17:16:15 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:16 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-df16232b-c7bd-4a26-acce-a5afafb6fbf5" returned: 0 in 0.701s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:16 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:16:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78297535-1a4c-4264-97c0-c2b3ea8e134e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df16232b-c7bd-4a26-acce-a5afafb6fbf5', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d021f7ae-dac9-4d75-b951-0ddb3b7000c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:16 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Volume volume-df16232b-c7bd-4a26-acce-a5afafb6fbf5 (df16232b-c7bd-4a26-acce-a5afafb6fbf5): created successfully Apr 29 17:16:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d021f7ae-dac9-4d75-b951-0ddb3b7000c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Flow 'volume_create_manager' (516eeea6-0eb5-4747-9038-3701d2d90152) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:16:16 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f8ef5652-4333-4c9b-a9df-11b390bf42f4 tempest-VolumesTestJSON-1358224619 None] Created volume successfully. Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Flow 'volume_create_manager' (578a25aa-7060-49ac-a8cb-ebaac05649ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1f5d53-5589-4b1e-a699-acc02a3ce0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1f5d53-5589-4b1e-a699-acc02a3ce0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-628191742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ced2996-94ae-4789-a61d-46abc490acfb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a3c33b8d1c3648f6aabba3fab4787b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:16:17Z,use_quota=True,user_id='5917fedb03e84f57aeec84598a88a278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20b01ce-c37f-4efa-a57c-1aa8c3863e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20b01ce-c37f-4efa-a57c-1aa8c3863e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c976d12f-563d-48d0-b80d-cd4fe3d222ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c976d12f-563d-48d0-b80d-cd4fe3d222ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ced2996-94ae-4789-a61d-46abc490acfb', 'volume_name': 'volume-3ced2996-94ae-4789-a61d-46abc490acfb', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4788c937-0bc3-4c8f-a382-125f0a053c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4788c937-0bc3-4c8f-a382-125f0a053c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdccd755-57db-4f8c-8410-51f365ce7cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:17 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Volume 3ced2996-94ae-4789-a61d-46abc490acfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ced2996-94ae-4789-a61d-46abc490acfb', 'volume_size': 1} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-628191742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ced2996-94ae-4789-a61d-46abc490acfb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a3c33b8d1c3648f6aabba3fab4787b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:16:17Z,use_quota=True,user_id='5917fedb03e84f57aeec84598a88a278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Creating volume 3ced2996-94ae-4789-a61d-46abc490acfb {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:16:17 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3ced2996-94ae-4789-a61d-46abc490acfb 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:17 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3ced2996-94ae-4789-a61d-46abc490acfb 1073741824 Apr 29 17:16:17 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Flow 'volume_create_manager' (4f4c43e2-48e8-40de-982d-0a602acfcf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79e12a9-17bf-4965-a1ce-5fd707a7562a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79e12a9-17bf-4965-a1ce-5fd707a7562a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2084160873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33042986-a510-4011-9ef9-f94277a8d9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1738a7f2650d419c9aac2764d2a0cd0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:16:18Z,use_quota=True,user_id='1c379bc09aaf41e9b348cbd784dba4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda7f4fc-7a74-440c-874f-e35d8b373b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda7f4fc-7a74-440c-874f-e35d8b373b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6860ebb3-78b5-4ff9-9c71-87284c46673a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6860ebb3-78b5-4ff9-9c71-87284c46673a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33042986-a510-4011-9ef9-f94277a8d9f0', 'volume_name': 'volume-33042986-a510-4011-9ef9-f94277a8d9f0', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a26cfc48-e7de-49d5-bb55-f6d028fa7f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a26cfc48-e7de-49d5-bb55-f6d028fa7f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85fc4a9-817d-43f3-b112-d175a903fceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:17 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Volume 33042986-a510-4011-9ef9-f94277a8d9f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33042986-a510-4011-9ef9-f94277a8d9f0', 'volume_size': 1} Apr 29 17:16:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:18 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3ced2996-94ae-4789-a61d-46abc490acfb 1073741824" returned: 0 in 0.913s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3ced2996-94ae-4789-a61d-46abc490acfb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:18 devstack sudo[93762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3ced2996-94ae-4789-a61d-46abc490acfb Apr 29 17:16:18 devstack sudo[93762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:19 devstack sudo[93762]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3ced2996-94ae-4789-a61d-46abc490acfb" returned: 0 in 0.653s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:16:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.458s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2084160873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33042986-a510-4011-9ef9-f94277a8d9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1738a7f2650d419c9aac2764d2a0cd0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:16:18Z,use_quota=True,user_id='1c379bc09aaf41e9b348cbd784dba4db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:16:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Creating volume 33042986-a510-4011-9ef9-f94277a8d9f0 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:16:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:16:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:16:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:16:19 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:16:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-33042986-a510-4011-9ef9-f94277a8d9f0 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:19 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-33042986-a510-4011-9ef9-f94277a8d9f0 1073741824 Apr 29 17:16:19 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdccd755-57db-4f8c-8410-51f365ce7cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ced2996-94ae-4789-a61d-46abc490acfb', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6b19c8-d7a5-42e8-8695-c014e45796d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:19 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Volume volume-3ced2996-94ae-4789-a61d-46abc490acfb (3ced2996-94ae-4789-a61d-46abc490acfb): created successfully Apr 29 17:16:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6b19c8-d7a5-42e8-8695-c014e45796d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Flow 'volume_create_manager' (578a25aa-7060-49ac-a8cb-ebaac05649ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:16:19 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e6c2deea-eec5-447f-8234-8f1e81a90b75 tempest-VolumesTestJSON-1358224619 None] Created volume successfully. Apr 29 17:16:20 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-33042986-a510-4011-9ef9-f94277a8d9f0 1073741824" returned: 0 in 0.935s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-33042986-a510-4011-9ef9-f94277a8d9f0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:20 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-33042986-a510-4011-9ef9-f94277a8d9f0 Apr 29 17:16:20 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d75ea4ce-dd1c-4045-b7fd-93b73e7c2660 tempest-VolumesTestJSON-1358224619 None] Acquiring lock "cinder-3ced2996-94ae-4789-a61d-46abc490acfb-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:16:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d75ea4ce-dd1c-4045-b7fd-93b73e7c2660 tempest-VolumesTestJSON-1358224619 None] Lock "cinder-3ced2996-94ae-4789-a61d-46abc490acfb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:16:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d75ea4ce-dd1c-4045-b7fd-93b73e7c2660 tempest-VolumesTestJSON-1358224619 None] Acquiring lock "cinder-quobyte-3ced2996-94ae-4789-a61d-46abc490acfb" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:16:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d75ea4ce-dd1c-4045-b7fd-93b73e7c2660 tempest-VolumesTestJSON-1358224619 None] Lock "cinder-quobyte-3ced2996-94ae-4789-a61d-46abc490acfb" acquired by "delete_volume" :: waited 0.020s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:16:20 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a10f40-4a15-4f50-bedf-126a3860b882]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:16:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d75ea4ce-dd1c-4045-b7fd-93b73e7c2660 tempest-VolumesTestJSON-1358224619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3ced2996-94ae-4789-a61d-46abc490acfb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:20 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-33042986-a510-4011-9ef9-f94277a8d9f0" returned: 0 in 0.815s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:20 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:16:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:20 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3ced2996-94ae-4789-a61d-46abc490acfb Apr 29 17:16:20 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85fc4a9-817d-43f3-b112-d175a903fceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33042986-a510-4011-9ef9-f94277a8d9f0', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7125a51c-c357-4777-a00c-0d2cabaa2ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:21 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Volume volume-33042986-a510-4011-9ef9-f94277a8d9f0 (33042986-a510-4011-9ef9-f94277a8d9f0): created successfully Apr 29 17:16:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7125a51c-c357-4777-a00c-0d2cabaa2ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Flow 'volume_create_manager' (4f4c43e2-48e8-40de-982d-0a602acfcf7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:16:21 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-336ef133-4f2b-4162-b555-efa198434798 tempest-ServerActionsTestOtherA-1495812231 None] Created volume successfully. Apr 29 17:16:21 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d75ea4ce-dd1c-4045-b7fd-93b73e7c2660 tempest-VolumesTestJSON-1358224619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3ced2996-94ae-4789-a61d-46abc490acfb" returned: 0 in 1.001s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d75ea4ce-dd1c-4045-b7fd-93b73e7c2660 tempest-VolumesTestJSON-1358224619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3ced2996-94ae-4789-a61d-46abc490acfb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:21 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3ced2996-94ae-4789-a61d-46abc490acfb Apr 29 17:16:21 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:22 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d75ea4ce-dd1c-4045-b7fd-93b73e7c2660 tempest-VolumesTestJSON-1358224619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3ced2996-94ae-4789-a61d-46abc490acfb" returned: 0 in 0.716s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d75ea4ce-dd1c-4045-b7fd-93b73e7c2660 tempest-VolumesTestJSON-1358224619 None] Lock "cinder-quobyte-3ced2996-94ae-4789-a61d-46abc490acfb" released by "delete_volume" :: held 1.766s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:16:22 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-d75ea4ce-dd1c-4045-b7fd-93b73e7c2660 tempest-VolumesTestJSON-1358224619 None] Created reservations ['0fbf1b1a-afab-46fb-85d0-9660404f5175', '47b04074-b5f2-4935-b2dd-aadf2c74cb9e', '8d9e4034-605b-447f-9457-54b8f122e24c', '00337fe0-f03a-4c58-868f-e8a47ecf6e72'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:16:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d75ea4ce-dd1c-4045-b7fd-93b73e7c2660 tempest-VolumesTestJSON-1358224619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d75ea4ce-dd1c-4045-b7fd-93b73e7c2660 tempest-VolumesTestJSON-1358224619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d75ea4ce-dd1c-4045-b7fd-93b73e7c2660 tempest-VolumesTestJSON-1358224619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:16:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d75ea4ce-dd1c-4045-b7fd-93b73e7c2660 tempest-VolumesTestJSON-1358224619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:16:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d75ea4ce-dd1c-4045-b7fd-93b73e7c2660 tempest-VolumesTestJSON-1358224619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d75ea4ce-dd1c-4045-b7fd-93b73e7c2660 tempest-VolumesTestJSON-1358224619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:22 devstack sudo[93822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:16:22 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-37b805b3-940e-476b-85a6-70d7e19075b6 tempest-VolumesTestJSON-1358224619 None] Acquiring lock "cinder-df16232b-c7bd-4a26-acce-a5afafb6fbf5-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:16:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-37b805b3-940e-476b-85a6-70d7e19075b6 tempest-VolumesTestJSON-1358224619 None] Lock "cinder-df16232b-c7bd-4a26-acce-a5afafb6fbf5-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:16:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-37b805b3-940e-476b-85a6-70d7e19075b6 tempest-VolumesTestJSON-1358224619 None] Acquiring lock "cinder-quobyte-df16232b-c7bd-4a26-acce-a5afafb6fbf5" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:16:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-37b805b3-940e-476b-85a6-70d7e19075b6 tempest-VolumesTestJSON-1358224619 None] Lock "cinder-quobyte-df16232b-c7bd-4a26-acce-a5afafb6fbf5" acquired by "delete_volume" :: waited 0.022s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:16:23 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dc32f9-1fa6-4ce0-9338-7fab2ded35dd]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:16:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-37b805b3-940e-476b-85a6-70d7e19075b6 tempest-VolumesTestJSON-1358224619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-df16232b-c7bd-4a26-acce-a5afafb6fbf5 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:23 devstack sudo[93849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-df16232b-c7bd-4a26-acce-a5afafb6fbf5 Apr 29 17:16:23 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:23 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d75ea4ce-dd1c-4045-b7fd-93b73e7c2660 tempest-VolumesTestJSON-1358224619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.786s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:23 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-d75ea4ce-dd1c-4045-b7fd-93b73e7c2660 tempest-VolumesTestJSON-1358224619 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:16:23 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d75ea4ce-dd1c-4045-b7fd-93b73e7c2660 tempest-VolumesTestJSON-1358224619 None] Deleted volume successfully. Apr 29 17:16:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d75ea4ce-dd1c-4045-b7fd-93b73e7c2660 tempest-VolumesTestJSON-1358224619 None] Lock "cinder-3ced2996-94ae-4789-a61d-46abc490acfb-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:16:24 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-37b805b3-940e-476b-85a6-70d7e19075b6 tempest-VolumesTestJSON-1358224619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-df16232b-c7bd-4a26-acce-a5afafb6fbf5" returned: 0 in 1.037s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-37b805b3-940e-476b-85a6-70d7e19075b6 tempest-VolumesTestJSON-1358224619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-df16232b-c7bd-4a26-acce-a5afafb6fbf5 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:24 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-df16232b-c7bd-4a26-acce-a5afafb6fbf5 Apr 29 17:16:24 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:24 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-37b805b3-940e-476b-85a6-70d7e19075b6 tempest-VolumesTestJSON-1358224619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-df16232b-c7bd-4a26-acce-a5afafb6fbf5" returned: 0 in 0.726s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-37b805b3-940e-476b-85a6-70d7e19075b6 tempest-VolumesTestJSON-1358224619 None] Lock "cinder-quobyte-df16232b-c7bd-4a26-acce-a5afafb6fbf5" released by "delete_volume" :: held 1.813s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:16:25 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-37b805b3-940e-476b-85a6-70d7e19075b6 tempest-VolumesTestJSON-1358224619 None] Created reservations ['637efe60-133f-45d9-91bf-ba47e656608d', '83100535-c39b-4480-87dc-0372de2b2f7c', 'ed61cbaa-70d3-4a3b-b47b-522d6c3a9541', 'f458e902-d8c3-4161-bc04-557281fef691'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:16:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-37b805b3-940e-476b-85a6-70d7e19075b6 tempest-VolumesTestJSON-1358224619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-37b805b3-940e-476b-85a6-70d7e19075b6 tempest-VolumesTestJSON-1358224619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:25 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-37b805b3-940e-476b-85a6-70d7e19075b6 tempest-VolumesTestJSON-1358224619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:16:25 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-37b805b3-940e-476b-85a6-70d7e19075b6 tempest-VolumesTestJSON-1358224619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:16:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-37b805b3-940e-476b-85a6-70d7e19075b6 tempest-VolumesTestJSON-1358224619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-37b805b3-940e-476b-85a6-70d7e19075b6 tempest-VolumesTestJSON-1358224619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:25 devstack sudo[93858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:16:25 devstack sudo[93858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-bd8c7169-cf2a-4824-bd07-9c7f0ca56708 tempest-VolumesTestJSON-1358224619 None] Acquiring lock "cinder-8c70efd7-a343-4307-bb42-d0af462da90e-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:16:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-bd8c7169-cf2a-4824-bd07-9c7f0ca56708 tempest-VolumesTestJSON-1358224619 None] Lock "cinder-8c70efd7-a343-4307-bb42-d0af462da90e-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:16:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-bd8c7169-cf2a-4824-bd07-9c7f0ca56708 tempest-VolumesTestJSON-1358224619 None] Acquiring lock "cinder-quobyte-8c70efd7-a343-4307-bb42-d0af462da90e" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:16:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-bd8c7169-cf2a-4824-bd07-9c7f0ca56708 tempest-VolumesTestJSON-1358224619 None] Lock "cinder-quobyte-8c70efd7-a343-4307-bb42-d0af462da90e" acquired by "delete_volume" :: waited 0.041s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:16:25 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52935bf-65b0-4e4f-9389-975a3dd05a80]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:16:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bd8c7169-cf2a-4824-bd07-9c7f0ca56708 tempest-VolumesTestJSON-1358224619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8c70efd7-a343-4307-bb42-d0af462da90e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:26 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8c70efd7-a343-4307-bb42-d0af462da90e Apr 29 17:16:26 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:26 devstack sudo[93858]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-37b805b3-940e-476b-85a6-70d7e19075b6 tempest-VolumesTestJSON-1358224619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.152s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:26 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-37b805b3-940e-476b-85a6-70d7e19075b6 tempest-VolumesTestJSON-1358224619 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:16:26 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-37b805b3-940e-476b-85a6-70d7e19075b6 tempest-VolumesTestJSON-1358224619 None] Deleted volume successfully. Apr 29 17:16:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-37b805b3-940e-476b-85a6-70d7e19075b6 tempest-VolumesTestJSON-1358224619 None] Lock "cinder-df16232b-c7bd-4a26-acce-a5afafb6fbf5-delete_volume" released by "delete_volume" :: held 3.239s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:16:26 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bd8c7169-cf2a-4824-bd07-9c7f0ca56708 tempest-VolumesTestJSON-1358224619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8c70efd7-a343-4307-bb42-d0af462da90e" returned: 0 in 1.132s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bd8c7169-cf2a-4824-bd07-9c7f0ca56708 tempest-VolumesTestJSON-1358224619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8c70efd7-a343-4307-bb42-d0af462da90e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:26 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8c70efd7-a343-4307-bb42-d0af462da90e Apr 29 17:16:26 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:28 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bd8c7169-cf2a-4824-bd07-9c7f0ca56708 tempest-VolumesTestJSON-1358224619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8c70efd7-a343-4307-bb42-d0af462da90e" returned: 0 in 1.176s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-bd8c7169-cf2a-4824-bd07-9c7f0ca56708 tempest-VolumesTestJSON-1358224619 None] Lock "cinder-quobyte-8c70efd7-a343-4307-bb42-d0af462da90e" released by "delete_volume" :: held 2.377s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:16:28 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-bd8c7169-cf2a-4824-bd07-9c7f0ca56708 tempest-VolumesTestJSON-1358224619 None] Created reservations ['8cc47303-1190-4199-91df-5a1c414fe850', '22b0eb90-1bcd-4bad-ab91-5a2d9289381c', '61483f4a-d483-487f-9131-1a70a50e84ba', 'a3bc5697-5ef4-4d10-92da-613fbcbc3e5d'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:16:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bd8c7169-cf2a-4824-bd07-9c7f0ca56708 tempest-VolumesTestJSON-1358224619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bd8c7169-cf2a-4824-bd07-9c7f0ca56708 tempest-VolumesTestJSON-1358224619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-bd8c7169-cf2a-4824-bd07-9c7f0ca56708 tempest-VolumesTestJSON-1358224619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:16:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-bd8c7169-cf2a-4824-bd07-9c7f0ca56708 tempest-VolumesTestJSON-1358224619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:16:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bd8c7169-cf2a-4824-bd07-9c7f0ca56708 tempest-VolumesTestJSON-1358224619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bd8c7169-cf2a-4824-bd07-9c7f0ca56708 tempest-VolumesTestJSON-1358224619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:28 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:16:28 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:29 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bd8c7169-cf2a-4824-bd07-9c7f0ca56708 tempest-VolumesTestJSON-1358224619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.949s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:29 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-bd8c7169-cf2a-4824-bd07-9c7f0ca56708 tempest-VolumesTestJSON-1358224619 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:16:29 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-bd8c7169-cf2a-4824-bd07-9c7f0ca56708 tempest-VolumesTestJSON-1358224619 None] Deleted volume successfully. Apr 29 17:16:29 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-bd8c7169-cf2a-4824-bd07-9c7f0ca56708 tempest-VolumesTestJSON-1358224619 None] Lock "cinder-8c70efd7-a343-4307-bb42-d0af462da90e-delete_volume" released by "delete_volume" :: held 3.748s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:16:34 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-6c142732-014d-41fc-af67-d45f0bc1fd76 tempest-GroupsTest-1704131821 None] Group tempest-Group1-1465415037: creating Apr 29 17:16:34 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=50,cinder:UPDATE=56,cinder:INSERT=17,cinder:DELETE=6 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:16:34 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-6c142732-014d-41fc-af67-d45f0bc1fd76 tempest-GroupsTest-1704131821 None] Group tempest-Group1-1465415037: created successfully Apr 29 17:16:34 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-6c142732-014d-41fc-af67-d45f0bc1fd76 tempest-GroupsTest-1704131821 None] Create group completed successfully. Apr 29 17:16:35 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-5ea64c28-69ac-4417-bfe2-b299368d6097 tempest-GroupsTest-1704131821 None] Group tempest-Group2-1161452396: creating Apr 29 17:16:35 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-5ea64c28-69ac-4417-bfe2-b299368d6097 tempest-GroupsTest-1704131821 None] Group tempest-Group2-1161452396: created successfully Apr 29 17:16:35 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-5ea64c28-69ac-4417-bfe2-b299368d6097 tempest-GroupsTest-1704131821 None] Create group completed successfully. Apr 29 17:16:35 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-a6c21eda-cc7d-4811-8637-b9b376cf3a5f tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Terminate volume connection completed successfully. Apr 29 17:16:35 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-a6c21eda-cc7d-4811-8637-b9b376cf3a5f tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Deleting attachment dce504a4-f2ce-47a0-8e63-3161d58a9081. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:16:36 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Acquiring lock "cinder-985580e2-7663-4006-9f80-542a412809bd-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:16:36 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "cinder-985580e2-7663-4006-9f80-542a412809bd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:16:36 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Acquiring lock "cinder-quobyte-985580e2-7663-4006-9f80-542a412809bd" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:16:36 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "cinder-quobyte-985580e2-7663-4006-9f80-542a412809bd" acquired by "delete_volume" :: waited 0.022s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:16:36 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2c950d-a170-4586-b0c1-2c7c67629bd3]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:16:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:36 devstack sudo[94027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd Apr 29 17:16:36 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Flow 'volume_create_manager' (4331eaad-6abf-48d9-8fca-38e2232835e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e36b159-b4a6-49fe-94ed-bd75c2707c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e36b159-b4a6-49fe-94ed-bd75c2707c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1197687362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3fd7f6af-4c70-4a9d-a2d1-a0215af3fd02,host='devstack@QuobyteHD#QuobyteHD',id=49f1fc2b-5189-4958-a706-503eac747643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaa877d816c41d7a0d6cd20177df3f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:16:37Z,use_quota=True,user_id='0b446fd54fa6449b91370c914e20b08c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26d3a397-dfd5-4aad-a1cf-3e6709881264),volume_type_id=26d3a397-dfd5-4aad-a1cf-3e6709881264)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a107ca-dab6-44f7-a0c0-dbc4628c795d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a107ca-dab6-44f7-a0c0-dbc4628c795d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b550718-a15d-4242-879a-58eb2401cfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b550718-a15d-4242-879a-58eb2401cfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f1fc2b-5189-4958-a706-503eac747643', 'volume_name': 'volume-49f1fc2b-5189-4958-a706-503eac747643', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0333b982-72fb-456d-b966-b5e01daa1ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0333b982-72fb-456d-b966-b5e01daa1ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5214fae-edfd-4203-81c8-2e5e4a793ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:37 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Volume 49f1fc2b-5189-4958-a706-503eac747643: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f1fc2b-5189-4958-a706-503eac747643', 'volume_size': 1} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3fd7f6af-4c70-4a9d-a2d1-a0215af3fd02,created_at=2026-04-29T15:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1197687362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3fd7f6af-4c70-4a9d-a2d1-a0215af3fd02,host='devstack@QuobyteHD#QuobyteHD',id=49f1fc2b-5189-4958-a706-503eac747643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaa877d816c41d7a0d6cd20177df3f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:16:37Z,use_quota=True,user_id='0b446fd54fa6449b91370c914e20b08c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(26d3a397-dfd5-4aad-a1cf-3e6709881264),volume_type_id=26d3a397-dfd5-4aad-a1cf-3e6709881264)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Creating volume 49f1fc2b-5189-4958-a706-503eac747643 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:16:37 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49f1fc2b-5189-4958-a706-503eac747643 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:37 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49f1fc2b-5189-4958-a706-503eac747643 1073741824 Apr 29 17:16:37 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:37 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd" returned: 0 in 1.002s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:37 devstack sudo[94034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd Apr 29 17:16:37 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:38 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49f1fc2b-5189-4958-a706-503eac747643 1073741824" returned: 0 in 1.140s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:38 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd" returned: 1 in 1.033s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:16:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:38 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd Apr 29 17:16:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49f1fc2b-5189-4958-a706-503eac747643 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:38 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:38 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49f1fc2b-5189-4958-a706-503eac747643 Apr 29 17:16:38 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:39 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-985580e2-7663-4006-9f80-542a412809bd" returned: 0 in 0.877s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:39 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "cinder-quobyte-985580e2-7663-4006-9f80-542a412809bd" released by "delete_volume" :: held 3.056s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:16:39 devstack cinder-volume[84547]: DEBUG cinder.quota [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Created reservations ['b82ecd33-e67b-4178-ac9e-3cf46f7514a1', '7382bd3e-bc3a-4406-a2fa-735167c6c2a3', '95f80b1c-4c16-4a09-8c45-4ebc3c7395cf', '895adcbf-db22-4bbd-ab0b-2c20590d50d0'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:16:39 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49f1fc2b-5189-4958-a706-503eac747643" returned: 0 in 1.158s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] <== create_volume: return (2364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:16:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.366s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5214fae-edfd-4203-81c8-2e5e4a793ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f1fc2b-5189-4958-a706-503eac747643', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2191ee-6124-4bbf-ae06-13c4c7069486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:39 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Volume volume-49f1fc2b-5189-4958-a706-503eac747643 (49f1fc2b-5189-4958-a706-503eac747643): created successfully Apr 29 17:16:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e2191ee-6124-4bbf-ae06-13c4c7069486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Flow 'volume_create_manager' (4331eaad-6abf-48d9-8fca-38e2232835e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:16:39 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4511f620-5e48-4c4f-a77d-3fd83258206b tempest-GroupsTest-1704131821 None] Created volume successfully. Apr 29 17:16:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:16:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:16:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:39 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:16:39 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:40 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.897s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:40 devstack cinder-volume[84547]: DEBUG cinder.manager [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:16:40 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Deleted volume successfully. Apr 29 17:16:40 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-e729b1c7-f370-44c0-a4f6-5fddd2105aa4 req-053c7ace-cb61-4774-afca-e5407a0ef297 tempest-ServerBootFromVolumeStableRescueTest-215259774 None] Lock "cinder-985580e2-7663-4006-9f80-542a412809bd-delete_volume" released by "delete_volume" :: held 4.505s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:16:41 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad006c90-6730-4dcd-a961-e1dfe7dd5802 tempest-GroupsTest-1704131821 None] Acquiring lock "cinder-quobyte-49f1fc2b-5189-4958-a706-503eac747643" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:16:41 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad006c90-6730-4dcd-a961-e1dfe7dd5802 tempest-GroupsTest-1704131821 None] Lock "cinder-quobyte-49f1fc2b-5189-4958-a706-503eac747643" acquired by "delete_volume" :: waited 0.032s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:16:41 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[5356efff-c278-416a-a7ef-079d55c23040]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:16:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad006c90-6730-4dcd-a961-e1dfe7dd5802 tempest-GroupsTest-1704131821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49f1fc2b-5189-4958-a706-503eac747643 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:41 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49f1fc2b-5189-4958-a706-503eac747643 Apr 29 17:16:41 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:42 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad006c90-6730-4dcd-a961-e1dfe7dd5802 tempest-GroupsTest-1704131821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49f1fc2b-5189-4958-a706-503eac747643" returned: 0 in 1.357s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad006c90-6730-4dcd-a961-e1dfe7dd5802 tempest-GroupsTest-1704131821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49f1fc2b-5189-4958-a706-503eac747643 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:43 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49f1fc2b-5189-4958-a706-503eac747643 Apr 29 17:16:43 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:43 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad006c90-6730-4dcd-a961-e1dfe7dd5802 tempest-GroupsTest-1704131821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49f1fc2b-5189-4958-a706-503eac747643" returned: 0 in 0.782s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:43 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad006c90-6730-4dcd-a961-e1dfe7dd5802 tempest-GroupsTest-1704131821 None] Lock "cinder-quobyte-49f1fc2b-5189-4958-a706-503eac747643" released by "delete_volume" :: held 2.226s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:16:43 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-ad006c90-6730-4dcd-a961-e1dfe7dd5802 tempest-GroupsTest-1704131821 None] Created reservations ['025501d1-9894-481a-985e-f04b1cf94fbf'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:16:43 devstack cinder-volume[84547]: WARNING cinder.quota [None req-ad006c90-6730-4dcd-a961-e1dfe7dd5802 tempest-GroupsTest-1704131821 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-401162862 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-401162862, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:16:43 devstack cinder-volume[84547]: WARNING cinder.quota [None req-ad006c90-6730-4dcd-a961-e1dfe7dd5802 tempest-GroupsTest-1704131821 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-401162862 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-401162862, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:16:43 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-ad006c90-6730-4dcd-a961-e1dfe7dd5802 tempest-GroupsTest-1704131821 None] Created reservations ['7b42e7d3-e9e3-464e-8b47-9132e52b2b5e', '44ee7b02-31ba-480e-874d-f56c234a6e53', '9436cd5c-4ba4-43ec-8e2f-54a768356e8a', 'b48c25a4-94e0-45e8-a702-591803c62398'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:16:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ad006c90-6730-4dcd-a961-e1dfe7dd5802 tempest-GroupsTest-1704131821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ad006c90-6730-4dcd-a961-e1dfe7dd5802 tempest-GroupsTest-1704131821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ad006c90-6730-4dcd-a961-e1dfe7dd5802 tempest-GroupsTest-1704131821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:16:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ad006c90-6730-4dcd-a961-e1dfe7dd5802 tempest-GroupsTest-1704131821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:16:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ad006c90-6730-4dcd-a961-e1dfe7dd5802 tempest-GroupsTest-1704131821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad006c90-6730-4dcd-a961-e1dfe7dd5802 tempest-GroupsTest-1704131821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:44 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:16:44 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:44 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad006c90-6730-4dcd-a961-e1dfe7dd5802 tempest-GroupsTest-1704131821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.649s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:44 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-ad006c90-6730-4dcd-a961-e1dfe7dd5802 tempest-GroupsTest-1704131821 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:16:44 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ad006c90-6730-4dcd-a961-e1dfe7dd5802 tempest-GroupsTest-1704131821 None] Delete group completed successfully. Apr 29 17:16:45 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-59b1ba45-0a58-4f03-af33-a58d16a93ed0 tempest-GroupsTest-1704131821 None] Created reservations ['69504306-b56f-48ce-a8cb-5174bd67cd8a'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:16:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-59b1ba45-0a58-4f03-af33-a58d16a93ed0 tempest-GroupsTest-1704131821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-59b1ba45-0a58-4f03-af33-a58d16a93ed0 tempest-GroupsTest-1704131821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-59b1ba45-0a58-4f03-af33-a58d16a93ed0 tempest-GroupsTest-1704131821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:16:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-59b1ba45-0a58-4f03-af33-a58d16a93ed0 tempest-GroupsTest-1704131821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:16:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-59b1ba45-0a58-4f03-af33-a58d16a93ed0 tempest-GroupsTest-1704131821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-59b1ba45-0a58-4f03-af33-a58d16a93ed0 tempest-GroupsTest-1704131821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:45 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:16:45 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:46 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-59b1ba45-0a58-4f03-af33-a58d16a93ed0 tempest-GroupsTest-1704131821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.701s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:46 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-59b1ba45-0a58-4f03-af33-a58d16a93ed0 tempest-GroupsTest-1704131821 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:16:46 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-59b1ba45-0a58-4f03-af33-a58d16a93ed0 tempest-GroupsTest-1704131821 None] Delete group completed successfully. Apr 29 17:16:47 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-9c1d36cb-76fc-4a9a-9b01-7a8d72b614eb tempest-GroupsTest-1704131821 None] Group tempest-GroupsTest-Group-2094277901: creating Apr 29 17:16:47 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-9c1d36cb-76fc-4a9a-9b01-7a8d72b614eb tempest-GroupsTest-1704131821 None] Group tempest-GroupsTest-Group-2094277901: created successfully Apr 29 17:16:47 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-9c1d36cb-76fc-4a9a-9b01-7a8d72b614eb tempest-GroupsTest-1704131821 None] Create group completed successfully. Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Flow 'volume_create_manager' (8e27807d-d80c-41f9-8249-7e1e46e402a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05d06a84-47ba-407f-9f33-86a4f343cc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05d06a84-47ba-407f-9f33-86a4f343cc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1110032868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=00c06d9c-6867-4d48-a189-2b0a83bb6909,host='devstack@QuobyteHD#QuobyteHD',id=522fc069-7ecc-4ff7-8213-e6c51fca1b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaa877d816c41d7a0d6cd20177df3f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:16:49Z,use_quota=True,user_id='0b446fd54fa6449b91370c914e20b08c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37a3df8c-50bf-4f25-9be3-e7eaf48701bf),volume_type_id=37a3df8c-50bf-4f25-9be3-e7eaf48701bf)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96f72db7-e6a5-45f8-b04e-78cb6c958f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96f72db7-e6a5-45f8-b04e-78cb6c958f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ffee5b-a109-4a0b-850b-15f28f55318b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ffee5b-a109-4a0b-850b-15f28f55318b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '522fc069-7ecc-4ff7-8213-e6c51fca1b77', 'volume_name': 'volume-522fc069-7ecc-4ff7-8213-e6c51fca1b77', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0734c36-44c1-4af7-ba9f-4fc7fd9c531e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0734c36-44c1-4af7-ba9f-4fc7fd9c531e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9b7456-1d27-4afd-afcf-0d11ad5d13b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:48 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Volume 522fc069-7ecc-4ff7-8213-e6c51fca1b77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-522fc069-7ecc-4ff7-8213-e6c51fca1b77', 'volume_size': 1} Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=00c06d9c-6867-4d48-a189-2b0a83bb6909,created_at=2026-04-29T15:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1110032868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=00c06d9c-6867-4d48-a189-2b0a83bb6909,host='devstack@QuobyteHD#QuobyteHD',id=522fc069-7ecc-4ff7-8213-e6c51fca1b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaa877d816c41d7a0d6cd20177df3f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:16:49Z,use_quota=True,user_id='0b446fd54fa6449b91370c914e20b08c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37a3df8c-50bf-4f25-9be3-e7eaf48701bf),volume_type_id=37a3df8c-50bf-4f25-9be3-e7eaf48701bf)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Creating volume 522fc069-7ecc-4ff7-8213-e6c51fca1b77 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:16:48 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:16:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-522fc069-7ecc-4ff7-8213-e6c51fca1b77 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:49 devstack sudo[94169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-522fc069-7ecc-4ff7-8213-e6c51fca1b77 1073741824 Apr 29 17:16:49 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:50 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-522fc069-7ecc-4ff7-8213-e6c51fca1b77 1073741824" returned: 0 in 1.076s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-522fc069-7ecc-4ff7-8213-e6c51fca1b77 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:50 devstack sudo[94231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-522fc069-7ecc-4ff7-8213-e6c51fca1b77 Apr 29 17:16:50 devstack sudo[94231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:50 devstack sudo[94231]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-522fc069-7ecc-4ff7-8213-e6c51fca1b77" returned: 0 in 0.699s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:16:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9b7456-1d27-4afd-afcf-0d11ad5d13b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-522fc069-7ecc-4ff7-8213-e6c51fca1b77', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41eb376e-22cd-4cbf-9a0d-bb28f3349552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:50 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Volume volume-522fc069-7ecc-4ff7-8213-e6c51fca1b77 (522fc069-7ecc-4ff7-8213-e6c51fca1b77): created successfully Apr 29 17:16:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41eb376e-22cd-4cbf-9a0d-bb28f3349552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Flow 'volume_create_manager' (8e27807d-d80c-41f9-8249-7e1e46e402a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:16:50 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-b2526e7d-2fad-4ab1-b52d-dc715b5af433 tempest-GroupsTest-1704131821 None] Created volume successfully. Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Flow 'volume_create_manager' (8af415ff-9f83-4ba5-a375-2630b3b83fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebbf1f8e-adcc-4704-81f0-ea291b8064b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebbf1f8e-adcc-4704-81f0-ea291b8064b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1662640730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=00c06d9c-6867-4d48-a189-2b0a83bb6909,host='devstack@QuobyteHD#QuobyteHD',id=083e86e1-ac62-4681-afc2-8f72b109badb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaa877d816c41d7a0d6cd20177df3f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:16:51Z,use_quota=True,user_id='0b446fd54fa6449b91370c914e20b08c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37a3df8c-50bf-4f25-9be3-e7eaf48701bf),volume_type_id=37a3df8c-50bf-4f25-9be3-e7eaf48701bf)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57531e43-ccc8-43af-96b8-ec0373169ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57531e43-ccc8-43af-96b8-ec0373169ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5c3fb6-163a-4134-9dbf-691a19b4a366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5c3fb6-163a-4134-9dbf-691a19b4a366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '083e86e1-ac62-4681-afc2-8f72b109badb', 'volume_name': 'volume-083e86e1-ac62-4681-afc2-8f72b109badb', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf353b4-a6ea-4d7d-92b2-952fc47b947d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf353b4-a6ea-4d7d-92b2-952fc47b947d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0809643-3021-4a88-806e-2a43170e14ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:51 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Volume 083e86e1-ac62-4681-afc2-8f72b109badb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-083e86e1-ac62-4681-afc2-8f72b109badb', 'volume_size': 1} Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=00c06d9c-6867-4d48-a189-2b0a83bb6909,created_at=2026-04-29T15:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1662640730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=00c06d9c-6867-4d48-a189-2b0a83bb6909,host='devstack@QuobyteHD#QuobyteHD',id=083e86e1-ac62-4681-afc2-8f72b109badb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eaa877d816c41d7a0d6cd20177df3f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:16:51Z,use_quota=True,user_id='0b446fd54fa6449b91370c914e20b08c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37a3df8c-50bf-4f25-9be3-e7eaf48701bf),volume_type_id=37a3df8c-50bf-4f25-9be3-e7eaf48701bf)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Creating volume 083e86e1-ac62-4681-afc2-8f72b109badb {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:16:51 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:16:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-083e86e1-ac62-4681-afc2-8f72b109badb 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:51 devstack sudo[94235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-083e86e1-ac62-4681-afc2-8f72b109badb 1073741824 Apr 29 17:16:51 devstack sudo[94235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:52 devstack sudo[94235]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-083e86e1-ac62-4681-afc2-8f72b109badb 1073741824" returned: 0 in 0.804s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-083e86e1-ac62-4681-afc2-8f72b109badb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:52 devstack sudo[94241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-083e86e1-ac62-4681-afc2-8f72b109badb Apr 29 17:16:52 devstack sudo[94241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:52 devstack sudo[94241]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-083e86e1-ac62-4681-afc2-8f72b109badb" returned: 0 in 0.609s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:16:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:16:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0809643-3021-4a88-806e-2a43170e14ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-083e86e1-ac62-4681-afc2-8f72b109badb', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a4f693f-6afc-4be9-bb09-f6bb44784b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:16:53 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Volume volume-083e86e1-ac62-4681-afc2-8f72b109badb (083e86e1-ac62-4681-afc2-8f72b109badb): created successfully Apr 29 17:16:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a4f693f-6afc-4be9-bb09-f6bb44784b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:16:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Flow 'volume_create_manager' (8af415ff-9f83-4ba5-a375-2630b3b83fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:16:53 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-236dfe78-a194-4039-af35-11a4ae072ede tempest-GroupsTest-1704131821 None] Created volume successfully. Apr 29 17:16:53 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f8cde68f-1ba7-443b-a765-1d7b6f239a1f tempest-GroupsTest-1704131821 None] Update group completed successfully. Apr 29 17:16:55 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-952437d2-f998-4f12-af45-bdb4070fe0fe tempest-GroupsTest-1704131821 None] Update group completed successfully. Apr 29 17:16:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Acquiring lock "cinder-quobyte-083e86e1-ac62-4681-afc2-8f72b109badb" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:16:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Lock "cinder-quobyte-083e86e1-ac62-4681-afc2-8f72b109badb" acquired by "delete_volume" :: waited 0.042s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:16:56 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e52844-4683-488e-8251-ebdeabeac63c]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:16:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-083e86e1-ac62-4681-afc2-8f72b109badb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:56 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-083e86e1-ac62-4681-afc2-8f72b109badb Apr 29 17:16:56 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:57 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-083e86e1-ac62-4681-afc2-8f72b109badb" returned: 0 in 0.864s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-083e86e1-ac62-4681-afc2-8f72b109badb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:57 devstack sudo[94253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-083e86e1-ac62-4681-afc2-8f72b109badb Apr 29 17:16:57 devstack sudo[94253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:58 devstack sudo[94253]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-083e86e1-ac62-4681-afc2-8f72b109badb" returned: 0 in 0.806s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Lock "cinder-quobyte-083e86e1-ac62-4681-afc2-8f72b109badb" released by "delete_volume" :: held 1.757s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:16:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Acquiring lock "cinder-quobyte-522fc069-7ecc-4ff7-8213-e6c51fca1b77" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:16:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Lock "cinder-quobyte-522fc069-7ecc-4ff7-8213-e6c51fca1b77" acquired by "delete_volume" :: waited 0.024s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:16:58 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d4aa72-81ef-42e8-9cd0-8fa583d1eefd]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:16:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-522fc069-7ecc-4ff7-8213-e6c51fca1b77 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:58 devstack sudo[94256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-522fc069-7ecc-4ff7-8213-e6c51fca1b77 Apr 29 17:16:58 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:59 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-522fc069-7ecc-4ff7-8213-e6c51fca1b77" returned: 0 in 0.817s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-522fc069-7ecc-4ff7-8213-e6c51fca1b77 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:16:59 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-522fc069-7ecc-4ff7-8213-e6c51fca1b77 Apr 29 17:16:59 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:16:59 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Apr 29 17:16:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-522fc069-7ecc-4ff7-8213-e6c51fca1b77" returned: 0 in 0.619s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:16:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Lock "cinder-quobyte-522fc069-7ecc-4ff7-8213-e6c51fca1b77" released by "delete_volume" :: held 1.491s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:16:59 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Created reservations ['71f6f63f-7789-4ebc-b8bb-fbb942ecde17'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:16:59 devstack cinder-volume[84547]: WARNING cinder.quota [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-993112473 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-993112473, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:16:59 devstack cinder-volume[84547]: WARNING cinder.quota [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-993112473 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-993112473, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:16:59 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Created reservations ['1c0654ee-1832-42a4-9927-a9337aac975e', 'eb042914-9bc0-41ef-a6b8-12b7ba2b0809', '54e970a3-c9c3-4a4b-bc2a-9f02a5de16be', 'db590b94-14e8-460f-a1d3-24be7da8afe8'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:17:00 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Created reservations ['502a9884-4f48-444e-8b49-84e1e7a79c89', '72460416-3643-44c5-a266-98a9340a6404', '4edda650-04ba-422d-a4e9-4e5850388586', 'a953a091-b101-466f-bfe3-9372dac80cf5'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:17:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:17:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:17:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:17:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:17:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:17:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:00 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:17:00 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:00 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.626s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:00 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:17:00 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-c470a389-904c-4e0a-95f1-fb1f431b56ac tempest-GroupsTest-1704131821 None] Delete group completed successfully. Apr 29 17:17:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-dfc12993-0556-4619-ab57-19d06fb6b4da req-7ec3a61a-03d2-430d-978e-cc7b2f85ccb5 tempest-ServerActionsTestOtherA-1495812231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:17:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-dfc12993-0556-4619-ab57-19d06fb6b4da req-7ec3a61a-03d2-430d-978e-cc7b2f85ccb5 tempest-ServerActionsTestOtherA-1495812231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:17:04 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3978d32-4179-4f6b-b979-56791b3dae81]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:17:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-dfc12993-0556-4619-ab57-19d06fb6b4da req-7ec3a61a-03d2-430d-978e-cc7b2f85ccb5 tempest-ServerActionsTestOtherA-1495812231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-33042986-a510-4011-9ef9-f94277a8d9f0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:04 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-33042986-a510-4011-9ef9-f94277a8d9f0 Apr 29 17:17:04 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:17:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:17:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:17:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:17:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:17:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:17:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:05 devstack sudo[94309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:17:05 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:05 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-dfc12993-0556-4619-ab57-19d06fb6b4da req-7ec3a61a-03d2-430d-978e-cc7b2f85ccb5 tempest-ServerActionsTestOtherA-1495812231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-33042986-a510-4011-9ef9-f94277a8d9f0" returned: 0 in 0.911s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-dfc12993-0556-4619-ab57-19d06fb6b4da req-7ec3a61a-03d2-430d-978e-cc7b2f85ccb5 tempest-ServerActionsTestOtherA-1495812231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.941s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:17:05 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-dfc12993-0556-4619-ab57-19d06fb6b4da req-7ec3a61a-03d2-430d-978e-cc7b2f85ccb5 tempest-ServerActionsTestOtherA-1495812231 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-33042986-a510-4011-9ef9-f94277a8d9f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2dc127f-3af8-4bf2-94aa-a6118c956d00', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:17:05 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-dfc12993-0556-4619-ab57-19d06fb6b4da req-7ec3a61a-03d2-430d-978e-cc7b2f85ccb5 tempest-ServerActionsTestOtherA-1495812231 None] attachment_update completed successfully. Apr 29 17:17:06 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.851s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:17:07 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-2ba18e10-adc3-4d3b-8a31-8253fac4dc12 tempest-GroupsV314Test-1321972206 None] Group tempest-GroupsV314Test-Group-202338465: creating Apr 29 17:17:07 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-2ba18e10-adc3-4d3b-8a31-8253fac4dc12 tempest-GroupsV314Test-1321972206 None] Group tempest-GroupsV314Test-Group-202338465: created successfully Apr 29 17:17:07 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-2ba18e10-adc3-4d3b-8a31-8253fac4dc12 tempest-GroupsV314Test-1321972206 None] Create group completed successfully. Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Flow 'volume_create_manager' (f3a57086-8dad-4387-95f1-c43ef92c8f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3cc935e-77d9-4bfc-bf18-3e2de9a27d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3cc935e-77d9-4bfc-bf18-3e2de9a27d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1712435552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4b690a28-fabd-4433-b8d5-29316047b093,host='devstack@QuobyteHD#QuobyteHD',id=f41d1864-6493-498f-b4e9-07ac9f48fc43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ee2bf7fc7e4858871ba2af280519f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:17:09Z,use_quota=True,user_id='f4ab18afef374df983cb50945f30b709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d8d4666-d22e-45c5-8a4a-57a998b7b8aa),volume_type_id=9d8d4666-d22e-45c5-8a4a-57a998b7b8aa)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee35c78-8eea-40a8-abf7-7e33ec147c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee35c78-8eea-40a8-abf7-7e33ec147c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbad319d-ca98-4ad5-a100-7bc386b9d1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbad319d-ca98-4ad5-a100-7bc386b9d1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f41d1864-6493-498f-b4e9-07ac9f48fc43', 'volume_name': 'volume-f41d1864-6493-498f-b4e9-07ac9f48fc43', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b460bf0-85a3-4499-a2be-9f2310ffe51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b460bf0-85a3-4499-a2be-9f2310ffe51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0a8fc2-6709-4b0a-9721-a48edb040813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:17:09 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Volume f41d1864-6493-498f-b4e9-07ac9f48fc43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f41d1864-6493-498f-b4e9-07ac9f48fc43', 'volume_size': 1} Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4b690a28-fabd-4433-b8d5-29316047b093,created_at=2026-04-29T15:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1712435552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4b690a28-fabd-4433-b8d5-29316047b093,host='devstack@QuobyteHD#QuobyteHD',id=f41d1864-6493-498f-b4e9-07ac9f48fc43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65ee2bf7fc7e4858871ba2af280519f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:17:09Z,use_quota=True,user_id='f4ab18afef374df983cb50945f30b709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d8d4666-d22e-45c5-8a4a-57a998b7b8aa),volume_type_id=9d8d4666-d22e-45c5-8a4a-57a998b7b8aa)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Creating volume f41d1864-6493-498f-b4e9-07ac9f48fc43 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:17:09 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:17:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:09 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 1073741824 Apr 29 17:17:09 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:10 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 1073741824" returned: 0 in 1.019s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:10 devstack sudo[94736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 Apr 29 17:17:10 devstack sudo[94736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:11 devstack sudo[94736]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43" returned: 0 in 0.844s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:17:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:17:11 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=77,cinder:INSERT=17,cinder:UPDATE=101,cinder:DELETE=4 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:17:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0a8fc2-6709-4b0a-9721-a48edb040813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f41d1864-6493-498f-b4e9-07ac9f48fc43', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:17:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a419fcde-fd21-4c7e-94b1-a33edeb2bd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:17:11 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Volume volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 (f41d1864-6493-498f-b4e9-07ac9f48fc43): created successfully Apr 29 17:17:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a419fcde-fd21-4c7e-94b1-a33edeb2bd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:17:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Flow 'volume_create_manager' (f3a57086-8dad-4387-95f1-c43ef92c8f06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:17:11 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-b5c45f87-f8a6-40d3-8247-b05d9ce1fb5b tempest-GroupsV314Test-1321972206 None] Created volume successfully. Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Flow 'volume_create_manager' (49cf98a7-788a-4dd7-9904-e585629aefa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6aaf6a4-e7a9-4ce1-8103-fdf913428cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6aaf6a4-e7a9-4ce1-8103-fdf913428cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1973024385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f40b90-f156-4d4b-97c1-3c62ecc4146c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63902f0e9d704c37abee8b2a0847011e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:17:12Z,use_quota=True,user_id='4ed0184f96234e7ba93a5d89530feba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f62162-97c0-469c-be82-a1a4a499328d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f62162-97c0-469c-be82-a1a4a499328d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3500dc18-ff3e-4689-92c6-a67ae0942f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3500dc18-ff3e-4689-92c6-a67ae0942f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68f40b90-f156-4d4b-97c1-3c62ecc4146c', 'volume_name': 'volume-68f40b90-f156-4d4b-97c1-3c62ecc4146c', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7a6c7f-7fca-469e-96d0-ed9e960692fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b7a6c7f-7fca-469e-96d0-ed9e960692fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf74e57e-9824-4310-ada8-2391329a10b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:17:12 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Volume 68f40b90-f156-4d4b-97c1-3c62ecc4146c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68f40b90-f156-4d4b-97c1-3c62ecc4146c', 'volume_size': 1} Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-1973024385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68f40b90-f156-4d4b-97c1-3c62ecc4146c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63902f0e9d704c37abee8b2a0847011e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:17:12Z,use_quota=True,user_id='4ed0184f96234e7ba93a5d89530feba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Creating volume 68f40b90-f156-4d4b-97c1-3c62ecc4146c {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:17:12 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68f40b90-f156-4d4b-97c1-3c62ecc4146c 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:12 devstack sudo[94739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68f40b90-f156-4d4b-97c1-3c62ecc4146c 1073741824 Apr 29 17:17:12 devstack sudo[94739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:17:13 devstack sudo[94739]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68f40b90-f156-4d4b-97c1-3c62ecc4146c 1073741824" returned: 0 in 0.955s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68f40b90-f156-4d4b-97c1-3c62ecc4146c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:13 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68f40b90-f156-4d4b-97c1-3c62ecc4146c Apr 29 17:17:13 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:14 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-994e4220-f179-481b-8b50-888738743beb req-cf340979-4e39-4d66-8dc0-958fe2ca4649 tempest-ServerActionsTestOtherA-1495812231 None] Terminate volume connection completed successfully. Apr 29 17:17:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-994e4220-f179-481b-8b50-888738743beb req-cf340979-4e39-4d66-8dc0-958fe2ca4649 tempest-ServerActionsTestOtherA-1495812231 None] Deleting attachment d2dc127f-3af8-4bf2-94aa-a6118c956d00. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:17:14 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68f40b90-f156-4d4b-97c1-3c62ecc4146c" returned: 0 in 0.829s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:17:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:17:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.738s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:17:14 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Cloning volume f41d1864-6493-498f-b4e9-07ac9f48fc43 to volume e9727856-82fb-4820-a410-6b464a762e59 Apr 29 17:17:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf74e57e-9824-4310-ada8-2391329a10b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68f40b90-f156-4d4b-97c1-3c62ecc4146c', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:17:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1041831-3d92-4447-9a12-127a79d0fa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:17:14 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Volume volume-68f40b90-f156-4d4b-97c1-3c62ecc4146c (68f40b90-f156-4d4b-97c1-3c62ecc4146c): created successfully Apr 29 17:17:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1041831-3d92-4447-9a12-127a79d0fa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:17:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Flow 'volume_create_manager' (49cf98a7-788a-4dd7-9904-e585629aefa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:17:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Creating offline snapshot 41a0befc-6b16-4ef6-95cb-2dc2adc0871c of volume f41d1864-6493-498f-b4e9-07ac9f48fc43 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:17:14 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e2ac7cf5-4346-4507-8db0-5eebaaf7199a tempest-ServerStableDeviceRescueTest-508512582 None] Created volume successfully. Apr 29 17:17:14 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d40da58-84c5-429f-922f-4429d87f4873]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:17:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:14 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 Apr 29 17:17:14 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:15 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43" returned: 0 in 0.822s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:15 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c 1G Apr 29 17:17:15 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:16 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c 1G" returned: 0 in 0.880s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:16 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c Apr 29 17:17:16 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-994e4220-f179-481b-8b50-888738743beb req-f78cff4c-2a2d-4b29-9772-9eb8023d2bcb tempest-ServerActionsTestOtherA-1495812231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:17:16 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c" returned: 0 in 0.689s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:16 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c is being set with open permissions: ugo+rw: NotImplementedError Apr 29 17:17:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:16 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c Apr 29 17:17:16 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:17 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c" returned: 0 in 0.622s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:17 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.info Apr 29 17:17:17 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:18 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.info" returned: 0 in 0.615s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:18 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 17:17:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:18 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.info Apr 29 17:17:18 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:18 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.info" returned: 0 in 0.622s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:18 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Acquiring lock "cinder-quobyte-e9727856-82fb-4820-a410-6b464a762e59" by "_copy_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:17:18 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Lock "cinder-quobyte-e9727856-82fb-4820-a410-6b464a762e59" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:17:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] snapshot: 41a0befc-6b16-4ef6-95cb-2dc2adc0871c, volume: e9727856-82fb-4820-a410-6b464a762e59, {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 17:17:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:17:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:17:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:17:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:17:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:17:18 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b4efeb-1fa5-4a06-9f23-c5754b7e602a]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:17:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:19 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c Apr 29 17:17:19 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:19 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c" returned: 0 in 0.764s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f41d1864-6493-498f-b4e9-07ac9f48fc43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:17:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 17:17:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Creating direct copy from snapshot {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 17:17:19 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1c7d84-56b1-43f2-a6f7-fc47a16b7283]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:17:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:19 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 Apr 29 17:17:19 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:20 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43" returned: 0 in 0.753s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:20 devstack cinder-volume[84547]: DEBUG cinder.utils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Path /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9727856-82fb-4820-a410-6b464a762e59 not found in is_blk_device check {{(pid=84547) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 17:17:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9727856-82fb-4820-a410-6b464a762e59 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:20 devstack sudo[94869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9727856-82fb-4820-a410-6b464a762e59 Apr 29 17:17:20 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:26 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9727856-82fb-4820-a410-6b464a762e59" returned: 0 in 6.122s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:26 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[140996ac-d506-4ad4-ae74-ed9a43d6fc1e]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:17:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:26 devstack sudo[94913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 Apr 29 17:17:26 devstack sudo[94913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:27 devstack sudo[94913]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43" returned: 0 in 0.866s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:27 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43, size 1024.00 MB, duration 6.12 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9727856-82fb-4820-a410-6b464a762e59 {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:17:27 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Converted 1024.00 MB image at 167.24 MB/s Apr 29 17:17:27 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9727856-82fb-4820-a410-6b464a762e59 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 17:17:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9727856-82fb-4820-a410-6b464a762e59 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:27 devstack sudo[94918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9727856-82fb-4820-a410-6b464a762e59 Apr 29 17:17:27 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:27 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=73,cinder:UPDATE=57,cinder:INSERT=16,cinder:DELETE=4 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:17:27 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:DELETE=1,cinder:UPDATE=4,cinder:SELECT=5,cinder:INSERT=2 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:17:28 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9727856-82fb-4820-a410-6b464a762e59" returned: 0 in 0.621s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Lock "cinder-quobyte-e9727856-82fb-4820-a410-6b464a762e59" released by "_copy_volume_from_snapshot" :: held 9.205s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:17:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Acquiring lock "cinder-quobyte-41a0befc-6b16-4ef6-95cb-2dc2adc0871c" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:17:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Lock "cinder-quobyte-41a0befc-6b16-4ef6-95cb-2dc2adc0871c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:17:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Deleting offline snapshot 41a0befc-6b16-4ef6-95cb-2dc2adc0871c of volume f41d1864-6493-498f-b4e9-07ac9f48fc43 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:17:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] snapshot_file for this snap is: volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:17:28 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[5154bf30-d943-4ceb-934e-95038af181bd]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:17:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:28 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c Apr 29 17:17:28 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:28 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c" returned: 0 in 0.745s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f41d1864-6493-498f-b4e9-07ac9f48fc43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:17:28 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[67800926-f3f4-4dc8-9829-a9b707ddf6d0]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:17:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:29 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 Apr 29 17:17:29 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:29 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43" returned: 0 in 0.731s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:29 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c Apr 29 17:17:29 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:30 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c" returned: 0 in 0.704s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:30 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c Apr 29 17:17:30 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:30 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43.41a0befc-6b16-4ef6-95cb-2dc2adc0871c" returned: 0 in 0.615s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Lock "cinder-quobyte-41a0befc-6b16-4ef6-95cb-2dc2adc0871c" released by "_delete_snapshot" :: held 2.910s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:17:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.680s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:17:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-994e4220-f179-481b-8b50-888738743beb req-f78cff4c-2a2d-4b29-9772-9eb8023d2bcb tempest-ServerActionsTestOtherA-1495812231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 14.190s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:17:31 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26c03c7-9d52-4da1-98c6-058b5d7e8ecd]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:17:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-994e4220-f179-481b-8b50-888738743beb req-f78cff4c-2a2d-4b29-9772-9eb8023d2bcb tempest-ServerActionsTestOtherA-1495812231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-33042986-a510-4011-9ef9-f94277a8d9f0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:31 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-314f6deb-9447-478a-8317-76f35e884dba tempest-GroupsV314Test-1321972206 None] Create group from source-group-4b690a28-fabd-4433-b8d5-29316047b093 completed successfully. Apr 29 17:17:31 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-33042986-a510-4011-9ef9-f94277a8d9f0 Apr 29 17:17:31 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:32 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-994e4220-f179-481b-8b50-888738743beb req-f78cff4c-2a2d-4b29-9772-9eb8023d2bcb tempest-ServerActionsTestOtherA-1495812231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-33042986-a510-4011-9ef9-f94277a8d9f0" returned: 0 in 1.234s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-994e4220-f179-481b-8b50-888738743beb req-f78cff4c-2a2d-4b29-9772-9eb8023d2bcb tempest-ServerActionsTestOtherA-1495812231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.254s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:17:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-994e4220-f179-481b-8b50-888738743beb req-f78cff4c-2a2d-4b29-9772-9eb8023d2bcb tempest-ServerActionsTestOtherA-1495812231 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-33042986-a510-4011-9ef9-f94277a8d9f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c90e215-9a89-4495-a339-535fef905982', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:17:32 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-994e4220-f179-481b-8b50-888738743beb req-f78cff4c-2a2d-4b29-9772-9eb8023d2bcb tempest-ServerActionsTestOtherA-1495812231 None] attachment_update completed successfully. Apr 29 17:17:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c14b1b17-ce85-4d10-8592-e5aaf4b3c8f7 tempest-GroupsV314Test-1321972206 None] Acquiring lock "cinder-quobyte-e9727856-82fb-4820-a410-6b464a762e59" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:17:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c14b1b17-ce85-4d10-8592-e5aaf4b3c8f7 tempest-GroupsV314Test-1321972206 None] Lock "cinder-quobyte-e9727856-82fb-4820-a410-6b464a762e59" acquired by "delete_volume" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:17:32 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e5749b-40fa-4567-920b-84776bbf63e1]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:17:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c14b1b17-ce85-4d10-8592-e5aaf4b3c8f7 tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9727856-82fb-4820-a410-6b464a762e59 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:32 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9727856-82fb-4820-a410-6b464a762e59 Apr 29 17:17:32 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:33 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c14b1b17-ce85-4d10-8592-e5aaf4b3c8f7 tempest-GroupsV314Test-1321972206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9727856-82fb-4820-a410-6b464a762e59" returned: 0 in 0.801s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c14b1b17-ce85-4d10-8592-e5aaf4b3c8f7 tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9727856-82fb-4820-a410-6b464a762e59 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:33 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9727856-82fb-4820-a410-6b464a762e59 Apr 29 17:17:33 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:34 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c14b1b17-ce85-4d10-8592-e5aaf4b3c8f7 tempest-GroupsV314Test-1321972206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9727856-82fb-4820-a410-6b464a762e59" returned: 0 in 0.810s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c14b1b17-ce85-4d10-8592-e5aaf4b3c8f7 tempest-GroupsV314Test-1321972206 None] Lock "cinder-quobyte-e9727856-82fb-4820-a410-6b464a762e59" released by "delete_volume" :: held 1.669s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:17:34 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-c14b1b17-ce85-4d10-8592-e5aaf4b3c8f7 tempest-GroupsV314Test-1321972206 None] Created reservations ['c859009e-ced2-4a1c-8513-2662b69ac075'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:17:34 devstack cinder-volume[84547]: WARNING cinder.quota [None req-c14b1b17-ce85-4d10-8592-e5aaf4b3c8f7 tempest-GroupsV314Test-1321972206 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1430079624 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1430079624, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:17:34 devstack cinder-volume[84547]: WARNING cinder.quota [None req-c14b1b17-ce85-4d10-8592-e5aaf4b3c8f7 tempest-GroupsV314Test-1321972206 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1430079624 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1430079624, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:17:34 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-c14b1b17-ce85-4d10-8592-e5aaf4b3c8f7 tempest-GroupsV314Test-1321972206 None] Created reservations ['5958447d-577a-430b-9dd8-dde7151100df', 'ac505f77-bdf1-42d2-9c1e-b3565b1ea63e', '370b71f0-344d-4334-bee3-4b646200b4d0', '91f50726-2ca5-4834-82fa-829dce604b4f'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:17:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c14b1b17-ce85-4d10-8592-e5aaf4b3c8f7 tempest-GroupsV314Test-1321972206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:17:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c14b1b17-ce85-4d10-8592-e5aaf4b3c8f7 tempest-GroupsV314Test-1321972206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:17:34 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c14b1b17-ce85-4d10-8592-e5aaf4b3c8f7 tempest-GroupsV314Test-1321972206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:17:34 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c14b1b17-ce85-4d10-8592-e5aaf4b3c8f7 tempest-GroupsV314Test-1321972206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:17:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c14b1b17-ce85-4d10-8592-e5aaf4b3c8f7 tempest-GroupsV314Test-1321972206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:17:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c14b1b17-ce85-4d10-8592-e5aaf4b3c8f7 tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:34 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:17:34 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:35 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0459956f-3c42-43a1-82f5-d83ae0f479d2 tempest-GroupsV314Test-1321972206 None] Acquiring lock "cinder-quobyte-f41d1864-6493-498f-b4e9-07ac9f48fc43" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:17:35 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0459956f-3c42-43a1-82f5-d83ae0f479d2 tempest-GroupsV314Test-1321972206 None] Lock "cinder-quobyte-f41d1864-6493-498f-b4e9-07ac9f48fc43" acquired by "delete_volume" :: waited 0.052s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:17:35 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d304032f-b26c-48ac-9964-f5915e230b86]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:17:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0459956f-3c42-43a1-82f5-d83ae0f479d2 tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:35 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 Apr 29 17:17:35 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:36 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c14b1b17-ce85-4d10-8592-e5aaf4b3c8f7 tempest-GroupsV314Test-1321972206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.484s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:36 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-c14b1b17-ce85-4d10-8592-e5aaf4b3c8f7 tempest-GroupsV314Test-1321972206 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:17:36 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-c14b1b17-ce85-4d10-8592-e5aaf4b3c8f7 tempest-GroupsV314Test-1321972206 None] Delete group completed successfully. Apr 29 17:17:36 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0459956f-3c42-43a1-82f5-d83ae0f479d2 tempest-GroupsV314Test-1321972206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43" returned: 0 in 1.242s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0459956f-3c42-43a1-82f5-d83ae0f479d2 tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:36 devstack sudo[95111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43 Apr 29 17:17:36 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:37 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0459956f-3c42-43a1-82f5-d83ae0f479d2 tempest-GroupsV314Test-1321972206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f41d1864-6493-498f-b4e9-07ac9f48fc43" returned: 0 in 0.787s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:37 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0459956f-3c42-43a1-82f5-d83ae0f479d2 tempest-GroupsV314Test-1321972206 None] Lock "cinder-quobyte-f41d1864-6493-498f-b4e9-07ac9f48fc43" released by "delete_volume" :: held 2.261s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:17:37 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-0459956f-3c42-43a1-82f5-d83ae0f479d2 tempest-GroupsV314Test-1321972206 None] Created reservations ['7e6d20f6-fa9f-42d4-93be-7dc64fb21c19'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:17:37 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-0459956f-3c42-43a1-82f5-d83ae0f479d2 tempest-GroupsV314Test-1321972206 None] Created reservations ['ffba39da-f6fb-4f9a-8391-0f6e6743eff3', 'b94f1800-2946-4e3f-9b7f-6a51f1cb4fb4', '0c35e180-d702-44b6-82e2-7b822d6338bf', '2b8752be-c2c4-4388-b789-e56e11aed341'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:17:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0459956f-3c42-43a1-82f5-d83ae0f479d2 tempest-GroupsV314Test-1321972206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:17:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0459956f-3c42-43a1-82f5-d83ae0f479d2 tempest-GroupsV314Test-1321972206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:17:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0459956f-3c42-43a1-82f5-d83ae0f479d2 tempest-GroupsV314Test-1321972206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:17:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0459956f-3c42-43a1-82f5-d83ae0f479d2 tempest-GroupsV314Test-1321972206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:17:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0459956f-3c42-43a1-82f5-d83ae0f479d2 tempest-GroupsV314Test-1321972206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:17:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0459956f-3c42-43a1-82f5-d83ae0f479d2 tempest-GroupsV314Test-1321972206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:37 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:17:37 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:38 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0459956f-3c42-43a1-82f5-d83ae0f479d2 tempest-GroupsV314Test-1321972206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.647s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:38 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-0459956f-3c42-43a1-82f5-d83ae0f479d2 tempest-GroupsV314Test-1321972206 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:17:38 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-0459956f-3c42-43a1-82f5-d83ae0f479d2 tempest-GroupsV314Test-1321972206 None] Delete group completed successfully. Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Flow 'volume_create_manager' (00a464fe-4ec3-48c6-a135-99d319c6a306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4f01d7-509c-4e68-b46a-89889b5a2c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4f01d7-509c-4e68-b46a-89889b5a2c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-822973996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4897cf-5e55-4e7f-8c98-7ea305747e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72177e8cb073416b97d790a6d2c36559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:17:46Z,use_quota=True,user_id='c3e1ce7acb804bb09d96c3074f5f78a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24438e3-fcba-4e5e-a93a-dcca32252679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a24438e3-fcba-4e5e-a93a-dcca32252679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd071d8-9b44-4042-a620-7793964cb205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd071d8-9b44-4042-a620-7793964cb205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d4897cf-5e55-4e7f-8c98-7ea305747e12', 'volume_name': 'volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8209c4-3e19-4290-bdca-a9af423f9a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8209c4-3e19-4290-bdca-a9af423f9a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96a8c5b-e672-4bc1-9d1a-c95f4b59d9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:17:45 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Volume 1d4897cf-5e55-4e7f-8c98-7ea305747e12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12', 'volume_size': 1} Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-822973996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4897cf-5e55-4e7f-8c98-7ea305747e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72177e8cb073416b97d790a6d2c36559',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:17:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:17:46Z,use_quota=True,user_id='c3e1ce7acb804bb09d96c3074f5f78a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Creating volume 1d4897cf-5e55-4e7f-8c98-7ea305747e12 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:17:45 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:17:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:45 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12 1073741824 Apr 29 17:17:45 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:46 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12 1073741824" returned: 0 in 0.787s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:46 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12 Apr 29 17:17:46 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:47 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12" returned: 0 in 0.616s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:17:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:17:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a96a8c5b-e672-4bc1-9d1a-c95f4b59d9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:17:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb24da52-685b-48e5-99f8-c7312bc524d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:17:47 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Volume volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12 (1d4897cf-5e55-4e7f-8c98-7ea305747e12): created successfully Apr 29 17:17:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb24da52-685b-48e5-99f8-c7312bc524d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:17:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Flow 'volume_create_manager' (00a464fe-4ec3-48c6-a135-99d319c6a306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:17:47 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-1c482138-c159-4187-81c4-daae4ffa9b5f tempest-SnapshotsActionsTest-155426166 None] Created volume successfully. Apr 29 17:17:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-962a8573-cf08-4b8b-aa83-b8c663cbe9c9 tempest-SnapshotsActionsTest-155426166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:17:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-962a8573-cf08-4b8b-aa83-b8c663cbe9c9 tempest-SnapshotsActionsTest-155426166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:17:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-962a8573-cf08-4b8b-aa83-b8c663cbe9c9 tempest-SnapshotsActionsTest-155426166 None] Creating offline snapshot 64f3b446-d755-4f64-b5a9-f86e054ba4c8 of volume 1d4897cf-5e55-4e7f-8c98-7ea305747e12 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:17:48 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e096347-3c32-4ab1-b45d-40a31b257e61]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:17:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-962a8573-cf08-4b8b-aa83-b8c663cbe9c9 tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:48 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12 Apr 29 17:17:48 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:48 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-962a8573-cf08-4b8b-aa83-b8c663cbe9c9 tempest-SnapshotsActionsTest-155426166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12" returned: 0 in 0.776s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-962a8573-cf08-4b8b-aa83-b8c663cbe9c9 tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:48 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 1G Apr 29 17:17:48 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:49 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-962a8573-cf08-4b8b-aa83-b8c663cbe9c9 tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 1G" returned: 0 in 0.791s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-962a8573-cf08-4b8b-aa83-b8c663cbe9c9 tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:49 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 Apr 29 17:17:49 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:50 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-962a8573-cf08-4b8b-aa83-b8c663cbe9c9 tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8" returned: 0 in 0.760s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:50 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-962a8573-cf08-4b8b-aa83-b8c663cbe9c9 tempest-SnapshotsActionsTest-155426166 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 is being set with open permissions: ugo+rw Apr 29 17:17:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-962a8573-cf08-4b8b-aa83-b8c663cbe9c9 tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:50 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 Apr 29 17:17:50 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:51 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-962a8573-cf08-4b8b-aa83-b8c663cbe9c9 tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8" returned: 0 in 0.619s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-962a8573-cf08-4b8b-aa83-b8c663cbe9c9 tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:51 devstack sudo[95628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.info Apr 29 17:17:51 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:51 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-962a8573-cf08-4b8b-aa83-b8c663cbe9c9 tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.info" returned: 0 in 0.640s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:51 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-962a8573-cf08-4b8b-aa83-b8c663cbe9c9 tempest-SnapshotsActionsTest-155426166 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.info is being set with open permissions: ugo+rw Apr 29 17:17:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-962a8573-cf08-4b8b-aa83-b8c663cbe9c9 tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:51 devstack sudo[95631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.info Apr 29 17:17:51 devstack sudo[95631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:52 devstack sudo[95631]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-962a8573-cf08-4b8b-aa83-b8c663cbe9c9 tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.info" returned: 0 in 0.640s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-962a8573-cf08-4b8b-aa83-b8c663cbe9c9 tempest-SnapshotsActionsTest-155426166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.333s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:17:52 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-962a8573-cf08-4b8b-aa83-b8c663cbe9c9 tempest-SnapshotsActionsTest-155426166 None] Create snapshot completed successfully Apr 29 17:17:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b63f8426-1fcd-4631-b1ce-c917e783b7cf tempest-SnapshotsActionsTest-155426166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:17:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b63f8426-1fcd-4631-b1ce-c917e783b7cf tempest-SnapshotsActionsTest-155426166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:17:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-b63f8426-1fcd-4631-b1ce-c917e783b7cf tempest-SnapshotsActionsTest-155426166 None] Creating offline snapshot 49185f7f-6649-4155-a00a-fbe916728192 of volume 1d4897cf-5e55-4e7f-8c98-7ea305747e12 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:17:53 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f05d19-5c8f-45db-b981-97589ec705b9]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:17:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b63f8426-1fcd-4631-b1ce-c917e783b7cf tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:54 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 Apr 29 17:17:54 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:54 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b63f8426-1fcd-4631-b1ce-c917e783b7cf tempest-SnapshotsActionsTest-155426166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8" returned: 0 in 0.828s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-b63f8426-1fcd-4631-b1ce-c917e783b7cf tempest-SnapshotsActionsTest-155426166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:17:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b63f8426-1fcd-4631-b1ce-c917e783b7cf tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.49185f7f-6649-4155-a00a-fbe916728192 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:54 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.49185f7f-6649-4155-a00a-fbe916728192 1G Apr 29 17:17:54 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:55 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b63f8426-1fcd-4631-b1ce-c917e783b7cf tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.49185f7f-6649-4155-a00a-fbe916728192 1G" returned: 0 in 0.744s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b63f8426-1fcd-4631-b1ce-c917e783b7cf tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.49185f7f-6649-4155-a00a-fbe916728192 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:55 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.49185f7f-6649-4155-a00a-fbe916728192 Apr 29 17:17:55 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:56 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b63f8426-1fcd-4631-b1ce-c917e783b7cf tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.49185f7f-6649-4155-a00a-fbe916728192" returned: 0 in 0.673s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:56 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-b63f8426-1fcd-4631-b1ce-c917e783b7cf tempest-SnapshotsActionsTest-155426166 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.49185f7f-6649-4155-a00a-fbe916728192 is being set with open permissions: ugo+rw Apr 29 17:17:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b63f8426-1fcd-4631-b1ce-c917e783b7cf tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.49185f7f-6649-4155-a00a-fbe916728192 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:56 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.49185f7f-6649-4155-a00a-fbe916728192 Apr 29 17:17:56 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:56 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b63f8426-1fcd-4631-b1ce-c917e783b7cf tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.49185f7f-6649-4155-a00a-fbe916728192" returned: 0 in 0.632s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b63f8426-1fcd-4631-b1ce-c917e783b7cf tempest-SnapshotsActionsTest-155426166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.977s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:17:56 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-b63f8426-1fcd-4631-b1ce-c917e783b7cf tempest-SnapshotsActionsTest-155426166 None] Create snapshot completed successfully Apr 29 17:17:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] Acquiring lock "cinder-49185f7f-6649-4155-a00a-fbe916728192-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:17:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-49185f7f-6649-4155-a00a-fbe916728192-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:17:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] Acquiring lock "cinder-quobyte-1d4897cf-5e55-4e7f-8c98-7ea305747e12" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:17:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-quobyte-1d4897cf-5e55-4e7f-8c98-7ea305747e12" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:17:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] Acquiring lock "cinder-quobyte-49185f7f-6649-4155-a00a-fbe916728192" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:17:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-quobyte-49185f7f-6649-4155-a00a-fbe916728192" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:17:57 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] Deleting offline snapshot 49185f7f-6649-4155-a00a-fbe916728192 of volume 1d4897cf-5e55-4e7f-8c98-7ea305747e12 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:17:57 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] snapshot_file for this snap is: volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.49185f7f-6649-4155-a00a-fbe916728192 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:17:57 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[82125e93-1714-421a-80dd-80f345b7f69c]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:17:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.49185f7f-6649-4155-a00a-fbe916728192 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:57 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.49185f7f-6649-4155-a00a-fbe916728192 Apr 29 17:17:57 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:57 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.49185f7f-6649-4155-a00a-fbe916728192" returned: 0 in 0.763s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:57 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:17:57 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbaa9fe2-0b57-42ab-9668-a8dc89d7187a]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:17:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:58 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 Apr 29 17:17:58 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:58 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8" returned: 0 in 0.746s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:58 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:17:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.49185f7f-6649-4155-a00a-fbe916728192 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:58 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.49185f7f-6649-4155-a00a-fbe916728192 Apr 29 17:17:58 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:17:59 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Apr 29 17:17:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.49185f7f-6649-4155-a00a-fbe916728192" returned: 0 in 0.731s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:17:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.49185f7f-6649-4155-a00a-fbe916728192 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:17:59 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.49185f7f-6649-4155-a00a-fbe916728192 Apr 29 17:17:59 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:00 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.49185f7f-6649-4155-a00a-fbe916728192" returned: 0 in 0.604s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-quobyte-49185f7f-6649-4155-a00a-fbe916728192" released by "_delete_snapshot" :: held 2.949s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:18:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-quobyte-1d4897cf-5e55-4e7f-8c98-7ea305747e12" released by "delete_snapshot" :: held 2.982s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:18:00 devstack cinder-volume[84547]: WARNING cinder.quota [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:18:00 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] Created reservations ['b21d42ad-5014-4c41-a190-f26235069ea4', '5f9b9eba-780f-4a3a-8b69-ce1229274ca6', 'c0dc052c-8732-44d8-aced-2a35373e8b83', 'c14dc7d5-e537-41af-a5a8-7692f794931e'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:18:00 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] Delete snapshot completed successfully. Apr 29 17:18:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1f9bb0bf-a5f0-4f4c-aaf0-7ebeaf6a8604 tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-49185f7f-6649-4155-a00a-fbe916728192-delete_snapshot" released by "delete_snapshot" :: held 3.127s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:18:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-af4c0273-e081-49f2-9597-fab9d836f12b tempest-SnapshotsActionsTest-155426166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:18:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-af4c0273-e081-49f2-9597-fab9d836f12b tempest-SnapshotsActionsTest-155426166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:18:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-af4c0273-e081-49f2-9597-fab9d836f12b tempest-SnapshotsActionsTest-155426166 None] Creating offline snapshot 1740142d-4aea-4b8b-b31a-944aa7c44daa of volume 1d4897cf-5e55-4e7f-8c98-7ea305747e12 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:18:00 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[94df3b97-ff7b-4512-84c8-4f0800b6d499]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:18:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af4c0273-e081-49f2-9597-fab9d836f12b tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:00 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 Apr 29 17:18:00 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:01 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af4c0273-e081-49f2-9597-fab9d836f12b tempest-SnapshotsActionsTest-155426166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8" returned: 0 in 0.831s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-af4c0273-e081-49f2-9597-fab9d836f12b tempest-SnapshotsActionsTest-155426166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:18:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af4c0273-e081-49f2-9597-fab9d836f12b tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1740142d-4aea-4b8b-b31a-944aa7c44daa 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:01 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1740142d-4aea-4b8b-b31a-944aa7c44daa 1G Apr 29 17:18:01 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:02 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af4c0273-e081-49f2-9597-fab9d836f12b tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1740142d-4aea-4b8b-b31a-944aa7c44daa 1G" returned: 0 in 0.953s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af4c0273-e081-49f2-9597-fab9d836f12b tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1740142d-4aea-4b8b-b31a-944aa7c44daa {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:02 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1740142d-4aea-4b8b-b31a-944aa7c44daa Apr 29 17:18:02 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:03 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af4c0273-e081-49f2-9597-fab9d836f12b tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1740142d-4aea-4b8b-b31a-944aa7c44daa" returned: 0 in 0.840s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:03 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-af4c0273-e081-49f2-9597-fab9d836f12b tempest-SnapshotsActionsTest-155426166 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1740142d-4aea-4b8b-b31a-944aa7c44daa is being set with open permissions: ugo+rw Apr 29 17:18:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af4c0273-e081-49f2-9597-fab9d836f12b tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1740142d-4aea-4b8b-b31a-944aa7c44daa {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:03 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1740142d-4aea-4b8b-b31a-944aa7c44daa Apr 29 17:18:03 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:03 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af4c0273-e081-49f2-9597-fab9d836f12b tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1740142d-4aea-4b8b-b31a-944aa7c44daa" returned: 0 in 0.670s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-af4c0273-e081-49f2-9597-fab9d836f12b tempest-SnapshotsActionsTest-155426166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.391s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:18:03 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-af4c0273-e081-49f2-9597-fab9d836f12b tempest-SnapshotsActionsTest-155426166 None] Create snapshot completed successfully Apr 29 17:18:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] Acquiring lock "cinder-1740142d-4aea-4b8b-b31a-944aa7c44daa-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:18:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-1740142d-4aea-4b8b-b31a-944aa7c44daa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:18:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] Acquiring lock "cinder-quobyte-1d4897cf-5e55-4e7f-8c98-7ea305747e12" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:18:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-quobyte-1d4897cf-5e55-4e7f-8c98-7ea305747e12" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:18:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] Acquiring lock "cinder-quobyte-1740142d-4aea-4b8b-b31a-944aa7c44daa" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:18:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-quobyte-1740142d-4aea-4b8b-b31a-944aa7c44daa" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:18:04 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] Deleting offline snapshot 1740142d-4aea-4b8b-b31a-944aa7c44daa of volume 1d4897cf-5e55-4e7f-8c98-7ea305747e12 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:18:04 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] snapshot_file for this snap is: volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1740142d-4aea-4b8b-b31a-944aa7c44daa {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:18:05 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c80a403-06c6-4df6-b0f8-e95cbefa66e3]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:18:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1740142d-4aea-4b8b-b31a-944aa7c44daa {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:05 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-98382789-95bb-4b9a-be4c-84d6562b4764 req-d349af64-bed5-4881-b7db-9cdaf6267333 tempest-ServerActionsTestOtherA-1495812231 None] Terminate volume connection completed successfully. Apr 29 17:18:05 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-98382789-95bb-4b9a-be4c-84d6562b4764 req-d349af64-bed5-4881-b7db-9cdaf6267333 tempest-ServerActionsTestOtherA-1495812231 None] Deleting attachment 0c90e215-9a89-4495-a339-535fef905982. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:18:05 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1740142d-4aea-4b8b-b31a-944aa7c44daa Apr 29 17:18:05 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:18:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:18:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:18:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:18:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:18:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:18:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:05 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:18:05 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:05 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1740142d-4aea-4b8b-b31a-944aa7c44daa" returned: 0 in 0.862s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:18:05 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[1921492c-c0d5-4d79-bd28-aa0ad5c5e7f0]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:18:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:06 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 Apr 29 17:18:06 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:06 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.668s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:18:06 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8" returned: 0 in 0.791s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:18:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1740142d-4aea-4b8b-b31a-944aa7c44daa {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:06 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1740142d-4aea-4b8b-b31a-944aa7c44daa Apr 29 17:18:06 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:07 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1740142d-4aea-4b8b-b31a-944aa7c44daa" returned: 0 in 0.844s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1740142d-4aea-4b8b-b31a-944aa7c44daa {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:07 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1740142d-4aea-4b8b-b31a-944aa7c44daa Apr 29 17:18:07 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:08 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1740142d-4aea-4b8b-b31a-944aa7c44daa" returned: 0 in 0.602s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:08 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-quobyte-1740142d-4aea-4b8b-b31a-944aa7c44daa" released by "_delete_snapshot" :: held 3.248s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:18:08 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-quobyte-1d4897cf-5e55-4e7f-8c98-7ea305747e12" released by "delete_snapshot" :: held 3.329s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:18:08 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] Created reservations ['f51eef8a-0d07-4903-927d-40140bffcb42', 'd1733816-ac1a-475b-b72d-d55eb3a12949', 'e60be0ff-473f-4528-aa6a-f3a05fcf33c7', 'de846d24-a1a2-46fe-9592-6bead3c99e2d'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:18:08 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] Delete snapshot completed successfully. Apr 29 17:18:08 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ce3a8622-3bfe-46f3-9dbb-9a125ccd26ce tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-1740142d-4aea-4b8b-b31a-944aa7c44daa-delete_snapshot" released by "delete_snapshot" :: held 3.553s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:18:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ab0b3d5a-4348-43e9-a4c2-c7b37e0d3daa tempest-SnapshotsActionsTest-155426166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:18:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ab0b3d5a-4348-43e9-a4c2-c7b37e0d3daa tempest-SnapshotsActionsTest-155426166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:18:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-ab0b3d5a-4348-43e9-a4c2-c7b37e0d3daa tempest-SnapshotsActionsTest-155426166 None] Creating offline snapshot 1a82e872-eeb0-46ca-b2da-d8c6762a00e0 of volume 1d4897cf-5e55-4e7f-8c98-7ea305747e12 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:18:09 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f05a66-5c94-4965-a5c6-e5adf89357ca]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:18:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ab0b3d5a-4348-43e9-a4c2-c7b37e0d3daa tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:09 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 Apr 29 17:18:09 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:10 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ab0b3d5a-4348-43e9-a4c2-c7b37e0d3daa tempest-SnapshotsActionsTest-155426166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8" returned: 0 in 0.819s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-ab0b3d5a-4348-43e9-a4c2-c7b37e0d3daa tempest-SnapshotsActionsTest-155426166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:18:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ab0b3d5a-4348-43e9-a4c2-c7b37e0d3daa tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1a82e872-eeb0-46ca-b2da-d8c6762a00e0 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:10 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1a82e872-eeb0-46ca-b2da-d8c6762a00e0 1G Apr 29 17:18:10 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-e0674c16-89b3-4f97-98a7-b10e55d2da9f req-0fdfc758-305c-4bfe-833e-287d9302569b tempest-ServerStableDeviceRescueTest-508512582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:18:11 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ab0b3d5a-4348-43e9-a4c2-c7b37e0d3daa tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1a82e872-eeb0-46ca-b2da-d8c6762a00e0 1G" returned: 0 in 0.912s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ab0b3d5a-4348-43e9-a4c2-c7b37e0d3daa tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1a82e872-eeb0-46ca-b2da-d8c6762a00e0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:11 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1a82e872-eeb0-46ca-b2da-d8c6762a00e0 Apr 29 17:18:11 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:11 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ab0b3d5a-4348-43e9-a4c2-c7b37e0d3daa tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1a82e872-eeb0-46ca-b2da-d8c6762a00e0" returned: 0 in 0.671s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:11 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-ab0b3d5a-4348-43e9-a4c2-c7b37e0d3daa tempest-SnapshotsActionsTest-155426166 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1a82e872-eeb0-46ca-b2da-d8c6762a00e0 is being set with open permissions: ugo+rw Apr 29 17:18:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ab0b3d5a-4348-43e9-a4c2-c7b37e0d3daa tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1a82e872-eeb0-46ca-b2da-d8c6762a00e0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:11 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1a82e872-eeb0-46ca-b2da-d8c6762a00e0 Apr 29 17:18:11 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:12 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ab0b3d5a-4348-43e9-a4c2-c7b37e0d3daa tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1a82e872-eeb0-46ca-b2da-d8c6762a00e0" returned: 0 in 0.633s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ab0b3d5a-4348-43e9-a4c2-c7b37e0d3daa tempest-SnapshotsActionsTest-155426166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.129s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:18:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-e0674c16-89b3-4f97-98a7-b10e55d2da9f req-0fdfc758-305c-4bfe-833e-287d9302569b tempest-ServerStableDeviceRescueTest-508512582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.525s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:18:12 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fe8c46-04a0-46a4-8207-d6fd571e10a9]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:18:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e0674c16-89b3-4f97-98a7-b10e55d2da9f req-0fdfc758-305c-4bfe-833e-287d9302569b tempest-ServerStableDeviceRescueTest-508512582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68f40b90-f156-4d4b-97c1-3c62ecc4146c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:12 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ab0b3d5a-4348-43e9-a4c2-c7b37e0d3daa tempest-SnapshotsActionsTest-155426166 None] Create snapshot completed successfully Apr 29 17:18:12 devstack sudo[95873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68f40b90-f156-4d4b-97c1-3c62ecc4146c Apr 29 17:18:12 devstack sudo[95873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:13 devstack sudo[95873]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-e0674c16-89b3-4f97-98a7-b10e55d2da9f req-0fdfc758-305c-4bfe-833e-287d9302569b tempest-ServerStableDeviceRescueTest-508512582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68f40b90-f156-4d4b-97c1-3c62ecc4146c" returned: 0 in 0.718s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-e0674c16-89b3-4f97-98a7-b10e55d2da9f req-0fdfc758-305c-4bfe-833e-287d9302569b tempest-ServerStableDeviceRescueTest-508512582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.738s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:18:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-e0674c16-89b3-4f97-98a7-b10e55d2da9f req-0fdfc758-305c-4bfe-833e-287d9302569b tempest-ServerStableDeviceRescueTest-508512582 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-68f40b90-f156-4d4b-97c1-3c62ecc4146c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a855059-467d-4f9a-bdc1-878d82a1cf0d', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:18:13 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-e0674c16-89b3-4f97-98a7-b10e55d2da9f req-0fdfc758-305c-4bfe-833e-287d9302569b tempest-ServerStableDeviceRescueTest-508512582 None] attachment_update completed successfully. Apr 29 17:18:13 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] Acquiring lock "cinder-1a82e872-eeb0-46ca-b2da-d8c6762a00e0-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:18:13 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-1a82e872-eeb0-46ca-b2da-d8c6762a00e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:18:13 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] Acquiring lock "cinder-quobyte-1d4897cf-5e55-4e7f-8c98-7ea305747e12" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:18:13 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-quobyte-1d4897cf-5e55-4e7f-8c98-7ea305747e12" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:18:13 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] Acquiring lock "cinder-quobyte-1a82e872-eeb0-46ca-b2da-d8c6762a00e0" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:18:13 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-quobyte-1a82e872-eeb0-46ca-b2da-d8c6762a00e0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:18:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] Deleting offline snapshot 1a82e872-eeb0-46ca-b2da-d8c6762a00e0 of volume 1d4897cf-5e55-4e7f-8c98-7ea305747e12 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:18:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] snapshot_file for this snap is: volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1a82e872-eeb0-46ca-b2da-d8c6762a00e0 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:18:13 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ba6ac5-2aa0-41b9-9ac4-191c716d13c2]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:18:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1a82e872-eeb0-46ca-b2da-d8c6762a00e0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:13 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1a82e872-eeb0-46ca-b2da-d8c6762a00e0 Apr 29 17:18:13 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:14 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1a82e872-eeb0-46ca-b2da-d8c6762a00e0" returned: 0 in 0.779s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:18:14 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[51916b07-ebb5-4cc8-ba79-bc5f248ebb85]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:18:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:14 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 Apr 29 17:18:14 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:15 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8" returned: 0 in 0.772s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:18:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1a82e872-eeb0-46ca-b2da-d8c6762a00e0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:15 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1a82e872-eeb0-46ca-b2da-d8c6762a00e0 Apr 29 17:18:15 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:15 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f6ff39f4-93cf-4ecd-9030-ebca99470994 tempest-ServerActionsTestOtherA-1495812231 None] Acquiring lock "cinder-33042986-a510-4011-9ef9-f94277a8d9f0-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:18:15 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f6ff39f4-93cf-4ecd-9030-ebca99470994 tempest-ServerActionsTestOtherA-1495812231 None] Lock "cinder-33042986-a510-4011-9ef9-f94277a8d9f0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:18:15 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f6ff39f4-93cf-4ecd-9030-ebca99470994 tempest-ServerActionsTestOtherA-1495812231 None] Acquiring lock "cinder-quobyte-33042986-a510-4011-9ef9-f94277a8d9f0" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:18:15 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f6ff39f4-93cf-4ecd-9030-ebca99470994 tempest-ServerActionsTestOtherA-1495812231 None] Lock "cinder-quobyte-33042986-a510-4011-9ef9-f94277a8d9f0" acquired by "delete_volume" :: waited 0.014s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:18:15 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[56349b0d-1eae-4f55-858a-e28094967d3f]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:18:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6ff39f4-93cf-4ecd-9030-ebca99470994 tempest-ServerActionsTestOtherA-1495812231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-33042986-a510-4011-9ef9-f94277a8d9f0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:15 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-33042986-a510-4011-9ef9-f94277a8d9f0 Apr 29 17:18:15 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:16 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1a82e872-eeb0-46ca-b2da-d8c6762a00e0" returned: 0 in 0.818s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1a82e872-eeb0-46ca-b2da-d8c6762a00e0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:16 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1a82e872-eeb0-46ca-b2da-d8c6762a00e0 Apr 29 17:18:16 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:16 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6ff39f4-93cf-4ecd-9030-ebca99470994 tempest-ServerActionsTestOtherA-1495812231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-33042986-a510-4011-9ef9-f94277a8d9f0" returned: 0 in 0.735s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6ff39f4-93cf-4ecd-9030-ebca99470994 tempest-ServerActionsTestOtherA-1495812231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-33042986-a510-4011-9ef9-f94277a8d9f0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:16 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-33042986-a510-4011-9ef9-f94277a8d9f0 Apr 29 17:18:16 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:16 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.1a82e872-eeb0-46ca-b2da-d8c6762a00e0" returned: 0 in 0.610s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:16 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-quobyte-1a82e872-eeb0-46ca-b2da-d8c6762a00e0" released by "_delete_snapshot" :: held 3.118s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:18:16 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-quobyte-1d4897cf-5e55-4e7f-8c98-7ea305747e12" released by "delete_snapshot" :: held 3.149s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:18:16 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6ff39f4-93cf-4ecd-9030-ebca99470994 tempest-ServerActionsTestOtherA-1495812231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-33042986-a510-4011-9ef9-f94277a8d9f0" returned: 0 in 0.644s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:16 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] Created reservations ['afdd3dea-5045-4bd9-b67d-0fae0d5c6494', 'ec01333a-bf16-4ae9-a901-6aa8fb43983b', 'c9c20440-8913-429c-874b-d1e14d7afb40', 'cb31480e-a078-4880-a772-749e4e2693c2'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:18:16 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f6ff39f4-93cf-4ecd-9030-ebca99470994 tempest-ServerActionsTestOtherA-1495812231 None] Lock "cinder-quobyte-33042986-a510-4011-9ef9-f94277a8d9f0" released by "delete_volume" :: held 1.432s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:18:17 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] Delete snapshot completed successfully. Apr 29 17:18:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e52f8629-c0d7-45b8-8d45-71fa4fb4229a tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-1a82e872-eeb0-46ca-b2da-d8c6762a00e0-delete_snapshot" released by "delete_snapshot" :: held 3.345s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:18:17 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-f6ff39f4-93cf-4ecd-9030-ebca99470994 tempest-ServerActionsTestOtherA-1495812231 None] Created reservations ['5c3f4456-ad55-4628-8f1e-b6d96d398988', '3a766da6-8c30-411c-8e70-0425c91d3d8e', 'fc979a08-1780-4ee9-a5cf-886dfed1e500', 'f7fd79d1-eb51-4362-ad57-7fb2bdf7b867'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:18:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f6ff39f4-93cf-4ecd-9030-ebca99470994 tempest-ServerActionsTestOtherA-1495812231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:18:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f6ff39f4-93cf-4ecd-9030-ebca99470994 tempest-ServerActionsTestOtherA-1495812231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:18:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f6ff39f4-93cf-4ecd-9030-ebca99470994 tempest-ServerActionsTestOtherA-1495812231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:18:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f6ff39f4-93cf-4ecd-9030-ebca99470994 tempest-ServerActionsTestOtherA-1495812231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:18:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f6ff39f4-93cf-4ecd-9030-ebca99470994 tempest-ServerActionsTestOtherA-1495812231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:18:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6ff39f4-93cf-4ecd-9030-ebca99470994 tempest-ServerActionsTestOtherA-1495812231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:17 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:18:17 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:17 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6ff39f4-93cf-4ecd-9030-ebca99470994 tempest-ServerActionsTestOtherA-1495812231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.592s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:17 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-f6ff39f4-93cf-4ecd-9030-ebca99470994 tempest-ServerActionsTestOtherA-1495812231 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:18:17 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f6ff39f4-93cf-4ecd-9030-ebca99470994 tempest-ServerActionsTestOtherA-1495812231 None] Deleted volume successfully. Apr 29 17:18:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f6ff39f4-93cf-4ecd-9030-ebca99470994 tempest-ServerActionsTestOtherA-1495812231 None] Lock "cinder-33042986-a510-4011-9ef9-f94277a8d9f0-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:18:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a3c1aca0-1b98-4f6b-aa4d-27160872d1b2 tempest-SnapshotsActionsTest-155426166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:18:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a3c1aca0-1b98-4f6b-aa4d-27160872d1b2 tempest-SnapshotsActionsTest-155426166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:18:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-a3c1aca0-1b98-4f6b-aa4d-27160872d1b2 tempest-SnapshotsActionsTest-155426166 None] Creating offline snapshot b739e35d-82ae-46e8-a142-60ce0f0daff9 of volume 1d4897cf-5e55-4e7f-8c98-7ea305747e12 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:18:18 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c2d946-5a36-43c1-9abb-15a5f6dda792]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:18:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a3c1aca0-1b98-4f6b-aa4d-27160872d1b2 tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:18 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 Apr 29 17:18:18 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:19 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a3c1aca0-1b98-4f6b-aa4d-27160872d1b2 tempest-SnapshotsActionsTest-155426166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8" returned: 0 in 0.832s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-a3c1aca0-1b98-4f6b-aa4d-27160872d1b2 tempest-SnapshotsActionsTest-155426166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:18:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a3c1aca0-1b98-4f6b-aa4d-27160872d1b2 tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.b739e35d-82ae-46e8-a142-60ce0f0daff9 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:19 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.b739e35d-82ae-46e8-a142-60ce0f0daff9 1G Apr 29 17:18:19 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:20 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a3c1aca0-1b98-4f6b-aa4d-27160872d1b2 tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.b739e35d-82ae-46e8-a142-60ce0f0daff9 1G" returned: 0 in 1.229s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a3c1aca0-1b98-4f6b-aa4d-27160872d1b2 tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.b739e35d-82ae-46e8-a142-60ce0f0daff9 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:20 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.b739e35d-82ae-46e8-a142-60ce0f0daff9 Apr 29 17:18:20 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:21 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a3c1aca0-1b98-4f6b-aa4d-27160872d1b2 tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.b739e35d-82ae-46e8-a142-60ce0f0daff9" returned: 0 in 0.679s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:21 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-a3c1aca0-1b98-4f6b-aa4d-27160872d1b2 tempest-SnapshotsActionsTest-155426166 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.b739e35d-82ae-46e8-a142-60ce0f0daff9 is being set with open permissions: ugo+rw Apr 29 17:18:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a3c1aca0-1b98-4f6b-aa4d-27160872d1b2 tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.b739e35d-82ae-46e8-a142-60ce0f0daff9 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:21 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.b739e35d-82ae-46e8-a142-60ce0f0daff9 Apr 29 17:18:21 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:21 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a3c1aca0-1b98-4f6b-aa4d-27160872d1b2 tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.b739e35d-82ae-46e8-a142-60ce0f0daff9" returned: 0 in 0.712s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a3c1aca0-1b98-4f6b-aa4d-27160872d1b2 tempest-SnapshotsActionsTest-155426166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.558s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:18:21 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-a3c1aca0-1b98-4f6b-aa4d-27160872d1b2 tempest-SnapshotsActionsTest-155426166 None] Create snapshot completed successfully Apr 29 17:18:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] Acquiring lock "cinder-b739e35d-82ae-46e8-a142-60ce0f0daff9-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:18:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-b739e35d-82ae-46e8-a142-60ce0f0daff9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:18:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] Acquiring lock "cinder-quobyte-1d4897cf-5e55-4e7f-8c98-7ea305747e12" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:18:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-quobyte-1d4897cf-5e55-4e7f-8c98-7ea305747e12" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:18:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] Acquiring lock "cinder-quobyte-b739e35d-82ae-46e8-a142-60ce0f0daff9" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:18:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-quobyte-b739e35d-82ae-46e8-a142-60ce0f0daff9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:18:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] Deleting offline snapshot b739e35d-82ae-46e8-a142-60ce0f0daff9 of volume 1d4897cf-5e55-4e7f-8c98-7ea305747e12 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:18:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] snapshot_file for this snap is: volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.b739e35d-82ae-46e8-a142-60ce0f0daff9 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:18:22 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c49460-fdd6-4f44-8b1f-6b2082df1724]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:18:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.b739e35d-82ae-46e8-a142-60ce0f0daff9 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:22 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.b739e35d-82ae-46e8-a142-60ce0f0daff9 Apr 29 17:18:22 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:23 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.b739e35d-82ae-46e8-a142-60ce0f0daff9" returned: 0 in 0.751s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:23 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:18:23 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a92c6ab-2658-4bbf-966e-32718c887837]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:18:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:23 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 Apr 29 17:18:23 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:24 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8" returned: 0 in 0.748s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:18:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.b739e35d-82ae-46e8-a142-60ce0f0daff9 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:24 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.b739e35d-82ae-46e8-a142-60ce0f0daff9 Apr 29 17:18:24 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:25 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.b739e35d-82ae-46e8-a142-60ce0f0daff9" returned: 0 in 0.772s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.b739e35d-82ae-46e8-a142-60ce0f0daff9 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:25 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.b739e35d-82ae-46e8-a142-60ce0f0daff9 Apr 29 17:18:25 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:25 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.b739e35d-82ae-46e8-a142-60ce0f0daff9" returned: 0 in 0.637s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-quobyte-b739e35d-82ae-46e8-a142-60ce0f0daff9" released by "_delete_snapshot" :: held 3.040s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:18:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-quobyte-1d4897cf-5e55-4e7f-8c98-7ea305747e12" released by "delete_snapshot" :: held 3.068s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:18:25 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] Created reservations ['ec9ef735-a3e6-4b65-93a2-a4d36034d7f5', '933a017c-ddb4-4768-a597-d67c32857741', '6b913314-4458-490e-82c9-a68b008103c3', 'b308822d-1968-414c-adc4-34e2c16777e8'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:18:25 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] Delete snapshot completed successfully. Apr 29 17:18:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6defb36a-84cc-413c-b4b6-9fa2778398b0 tempest-SnapshotsActionsTest-859911226 None] Lock "cinder-b739e35d-82ae-46e8-a142-60ce0f0daff9-delete_snapshot" released by "delete_snapshot" :: held 3.241s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:18:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] Acquiring lock "cinder-64f3b446-d755-4f64-b5a9-f86e054ba4c8-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:18:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] Lock "cinder-64f3b446-d755-4f64-b5a9-f86e054ba4c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:18:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] Acquiring lock "cinder-quobyte-1d4897cf-5e55-4e7f-8c98-7ea305747e12" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:18:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] Lock "cinder-quobyte-1d4897cf-5e55-4e7f-8c98-7ea305747e12" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:18:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] Acquiring lock "cinder-quobyte-64f3b446-d755-4f64-b5a9-f86e054ba4c8" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:18:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] Lock "cinder-quobyte-64f3b446-d755-4f64-b5a9-f86e054ba4c8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:18:27 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] Deleting offline snapshot 64f3b446-d755-4f64-b5a9-f86e054ba4c8 of volume 1d4897cf-5e55-4e7f-8c98-7ea305747e12 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:18:27 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] snapshot_file for this snap is: volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:18:27 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[72911a99-6e9c-4252-839c-9edd3b43acf4]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:18:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:27 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 Apr 29 17:18:27 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:28 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8" returned: 0 in 0.728s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:18:28 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[5890bed9-0e00-446e-84b7-9ee77962780f]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:18:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:28 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12 Apr 29 17:18:28 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:29 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12" returned: 0 in 0.773s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:29 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 Apr 29 17:18:29 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:29 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8" returned: 0 in 0.792s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:29 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8 Apr 29 17:18:29 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:30 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12.64f3b446-d755-4f64-b5a9-f86e054ba4c8" returned: 0 in 0.868s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:30 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=64,cinder:SELECT=66,cinder:INSERT=13,cinder:DELETE=4 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:18:30 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=69,cinder:SELECT=76,cinder:INSERT=19,cinder:DELETE=3 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:18:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] Lock "cinder-quobyte-64f3b446-d755-4f64-b5a9-f86e054ba4c8" released by "_delete_snapshot" :: held 3.327s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:18:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] Lock "cinder-quobyte-1d4897cf-5e55-4e7f-8c98-7ea305747e12" released by "delete_snapshot" :: held 3.366s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:18:30 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] Created reservations ['776ab359-5224-43c4-aac6-2b4c65d57f04', 'e6d6e1b3-f293-4cda-a695-3f95b43e519b', 'd30bff0b-9e0b-490e-b36f-1a5a3f502f59', '2d90e5ea-86ef-4d11-94bc-a29676bee0dc'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:18:31 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] Delete snapshot completed successfully. Apr 29 17:18:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7f850214-0c34-459b-860b-4de085c90cf8 tempest-SnapshotsActionsTest-155426166 None] Lock "cinder-64f3b446-d755-4f64-b5a9-f86e054ba4c8-delete_snapshot" released by "delete_snapshot" :: held 3.709s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:18:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b0971eff-6659-4541-8c3b-34f6eb28a2bf tempest-SnapshotsActionsTest-155426166 None] Acquiring lock "cinder-1d4897cf-5e55-4e7f-8c98-7ea305747e12-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:18:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b0971eff-6659-4541-8c3b-34f6eb28a2bf tempest-SnapshotsActionsTest-155426166 None] Lock "cinder-1d4897cf-5e55-4e7f-8c98-7ea305747e12-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:18:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b0971eff-6659-4541-8c3b-34f6eb28a2bf tempest-SnapshotsActionsTest-155426166 None] Acquiring lock "cinder-quobyte-1d4897cf-5e55-4e7f-8c98-7ea305747e12" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:18:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b0971eff-6659-4541-8c3b-34f6eb28a2bf tempest-SnapshotsActionsTest-155426166 None] Lock "cinder-quobyte-1d4897cf-5e55-4e7f-8c98-7ea305747e12" acquired by "delete_volume" :: waited 0.036s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:18:32 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[409ed2f7-930b-4377-a5cd-fdac931519b7]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:18:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b0971eff-6659-4541-8c3b-34f6eb28a2bf tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:32 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12 Apr 29 17:18:32 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:33 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b0971eff-6659-4541-8c3b-34f6eb28a2bf tempest-SnapshotsActionsTest-155426166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12" returned: 0 in 0.900s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b0971eff-6659-4541-8c3b-34f6eb28a2bf tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:33 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12 Apr 29 17:18:33 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:33 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b0971eff-6659-4541-8c3b-34f6eb28a2bf tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1d4897cf-5e55-4e7f-8c98-7ea305747e12" returned: 0 in 0.664s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:33 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b0971eff-6659-4541-8c3b-34f6eb28a2bf tempest-SnapshotsActionsTest-155426166 None] Lock "cinder-quobyte-1d4897cf-5e55-4e7f-8c98-7ea305747e12" released by "delete_volume" :: held 1.703s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:18:33 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-b0971eff-6659-4541-8c3b-34f6eb28a2bf tempest-SnapshotsActionsTest-155426166 None] Created reservations ['13419485-20b5-4e23-a45b-4f4e3ecd73d8', '77f30e51-6803-48dd-8f3e-5954276043a6', '3ee7cc89-c6a5-48ca-8640-cf5420cd6c0c', 'a9b179ff-7450-4d4e-a858-83fcdc02f3af'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:18:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b0971eff-6659-4541-8c3b-34f6eb28a2bf tempest-SnapshotsActionsTest-155426166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:18:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b0971eff-6659-4541-8c3b-34f6eb28a2bf tempest-SnapshotsActionsTest-155426166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:18:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b0971eff-6659-4541-8c3b-34f6eb28a2bf tempest-SnapshotsActionsTest-155426166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:18:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b0971eff-6659-4541-8c3b-34f6eb28a2bf tempest-SnapshotsActionsTest-155426166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:18:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b0971eff-6659-4541-8c3b-34f6eb28a2bf tempest-SnapshotsActionsTest-155426166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:18:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b0971eff-6659-4541-8c3b-34f6eb28a2bf tempest-SnapshotsActionsTest-155426166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:18:33 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:18:33 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:18:35 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Apr 29 17:18:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b0971eff-6659-4541-8c3b-34f6eb28a2bf tempest-SnapshotsActionsTest-155426166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.258s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:18:35 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-b0971eff-6659-4541-8c3b-34f6eb28a2bf tempest-SnapshotsActionsTest-155426166 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:18:35 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-b0971eff-6659-4541-8c3b-34f6eb28a2bf tempest-SnapshotsActionsTest-155426166 None] Deleted volume successfully. Apr 29 17:18:35 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b0971eff-6659-4541-8c3b-34f6eb28a2bf tempest-SnapshotsActionsTest-155426166 None] Lock "cinder-1d4897cf-5e55-4e7f-8c98-7ea305747e12-delete_volume" released by "delete_volume" :: held 3.342s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:18:43 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=9,cinder:INSERT=3,cinder:UPDATE=12 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:18:45 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=10,cinder:INSERT=5,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:19:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:19:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:19:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:19:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:19:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:19:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:19:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:19:05 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:19:05 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:19:06 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Apr 29 17:19:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.958s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:19:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:19:14 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-efe0890d-d062-4f43-a6bd-29e41217ef1d req-5be10646-3f81-4f92-a43b-477a9a6c0e99 tempest-ServerStableDeviceRescueTest-508512582 None] Terminate volume connection completed successfully. Apr 29 17:19:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-efe0890d-d062-4f43-a6bd-29e41217ef1d req-5be10646-3f81-4f92-a43b-477a9a6c0e99 tempest-ServerStableDeviceRescueTest-508512582 None] Deleting attachment 6a855059-467d-4f9a-bdc1-878d82a1cf0d. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:19:15 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f304fe53-9885-44d4-afef-cfcebdbb2c27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Acquiring lock "cinder-3c45d897-f210-4fe1-9f08-89a4bebe8f02-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:19:15 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f304fe53-9885-44d4-afef-cfcebdbb2c27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "cinder-3c45d897-f210-4fe1-9f08-89a4bebe8f02-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:19:15 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f304fe53-9885-44d4-afef-cfcebdbb2c27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Acquiring lock "cinder-quobyte-3c45d897-f210-4fe1-9f08-89a4bebe8f02" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:19:15 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f304fe53-9885-44d4-afef-cfcebdbb2c27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "cinder-quobyte-3c45d897-f210-4fe1-9f08-89a4bebe8f02" acquired by "delete_volume" :: waited 0.025s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:19:15 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07e4f30-49fe-43e7-81d7-3ba665775c55]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:19:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f304fe53-9885-44d4-afef-cfcebdbb2c27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c45d897-f210-4fe1-9f08-89a4bebe8f02 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:19:15 devstack sudo[96938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c45d897-f210-4fe1-9f08-89a4bebe8f02 Apr 29 17:19:15 devstack sudo[96938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:19:17 devstack sudo[96938]: pam_unix(sudo:session): session closed for user root Apr 29 17:19:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f304fe53-9885-44d4-afef-cfcebdbb2c27 tempest-ServerRescueNegativeTestJSON-1326654837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c45d897-f210-4fe1-9f08-89a4bebe8f02" returned: 0 in 1.361s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:19:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f304fe53-9885-44d4-afef-cfcebdbb2c27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c45d897-f210-4fe1-9f08-89a4bebe8f02 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:19:17 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c45d897-f210-4fe1-9f08-89a4bebe8f02 Apr 29 17:19:17 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:19:17 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Apr 29 17:19:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f304fe53-9885-44d4-afef-cfcebdbb2c27 tempest-ServerRescueNegativeTestJSON-1326654837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c45d897-f210-4fe1-9f08-89a4bebe8f02" returned: 0 in 0.807s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:19:18 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f304fe53-9885-44d4-afef-cfcebdbb2c27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "cinder-quobyte-3c45d897-f210-4fe1-9f08-89a4bebe8f02" released by "delete_volume" :: held 2.223s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:19:18 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-f304fe53-9885-44d4-afef-cfcebdbb2c27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Created reservations ['63bf1325-56b0-4d59-8343-8306da41e95a', '26c4596b-83a2-4bcf-a6b7-10956602472e', '808e7e99-84e8-4cf2-96cc-353a73453779', '773593ff-43ad-4d4c-9ab1-6f57ce96313d'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:19:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f304fe53-9885-44d4-afef-cfcebdbb2c27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:19:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f304fe53-9885-44d4-afef-cfcebdbb2c27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:19:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f304fe53-9885-44d4-afef-cfcebdbb2c27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:19:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f304fe53-9885-44d4-afef-cfcebdbb2c27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:19:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f304fe53-9885-44d4-afef-cfcebdbb2c27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:19:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f304fe53-9885-44d4-afef-cfcebdbb2c27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:19:18 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:19:18 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:19:19 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Apr 29 17:19:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f304fe53-9885-44d4-afef-cfcebdbb2c27 tempest-ServerRescueNegativeTestJSON-1326654837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.023s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:19:19 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-f304fe53-9885-44d4-afef-cfcebdbb2c27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:19:19 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f304fe53-9885-44d4-afef-cfcebdbb2c27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Deleted volume successfully. Apr 29 17:19:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f304fe53-9885-44d4-afef-cfcebdbb2c27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "cinder-3c45d897-f210-4fe1-9f08-89a4bebe8f02-delete_volume" released by "delete_volume" :: held 3.529s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:19:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ed55b4cc-9c10-44d5-aaeb-bb5a57d30f27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Acquiring lock "cinder-9f2c21a9-4515-4581-af2c-01338db1cbb7-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:19:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ed55b4cc-9c10-44d5-aaeb-bb5a57d30f27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "cinder-9f2c21a9-4515-4581-af2c-01338db1cbb7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:19:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ed55b4cc-9c10-44d5-aaeb-bb5a57d30f27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Acquiring lock "cinder-quobyte-9f2c21a9-4515-4581-af2c-01338db1cbb7" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:19:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ed55b4cc-9c10-44d5-aaeb-bb5a57d30f27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "cinder-quobyte-9f2c21a9-4515-4581-af2c-01338db1cbb7" acquired by "delete_volume" :: waited 0.026s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:19:19 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b038263f-6c62-48be-ac27-f4743b419287]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:19:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ed55b4cc-9c10-44d5-aaeb-bb5a57d30f27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9f2c21a9-4515-4581-af2c-01338db1cbb7 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:19:19 devstack sudo[97047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9f2c21a9-4515-4581-af2c-01338db1cbb7 Apr 29 17:19:19 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:19:20 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root Apr 29 17:19:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ed55b4cc-9c10-44d5-aaeb-bb5a57d30f27 tempest-ServerRescueNegativeTestJSON-1326654837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9f2c21a9-4515-4581-af2c-01338db1cbb7" returned: 0 in 0.842s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:19:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ed55b4cc-9c10-44d5-aaeb-bb5a57d30f27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9f2c21a9-4515-4581-af2c-01338db1cbb7 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:19:20 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9f2c21a9-4515-4581-af2c-01338db1cbb7 Apr 29 17:19:20 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:19:20 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Apr 29 17:19:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ed55b4cc-9c10-44d5-aaeb-bb5a57d30f27 tempest-ServerRescueNegativeTestJSON-1326654837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9f2c21a9-4515-4581-af2c-01338db1cbb7" returned: 0 in 0.685s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:19:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ed55b4cc-9c10-44d5-aaeb-bb5a57d30f27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "cinder-quobyte-9f2c21a9-4515-4581-af2c-01338db1cbb7" released by "delete_volume" :: held 1.610s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:19:21 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-ed55b4cc-9c10-44d5-aaeb-bb5a57d30f27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Created reservations ['4be675d0-e588-49dd-a487-b100d6228789', '77767ae3-2f01-4dec-a0f2-11efe7d4cec3', '3e1931e4-c4ec-4059-b07e-b86bf641c7d1', 'a7d08640-cb9b-4d72-bdf2-e8332e9ecbdb'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:19:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ed55b4cc-9c10-44d5-aaeb-bb5a57d30f27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:19:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ed55b4cc-9c10-44d5-aaeb-bb5a57d30f27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:19:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ed55b4cc-9c10-44d5-aaeb-bb5a57d30f27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:19:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ed55b4cc-9c10-44d5-aaeb-bb5a57d30f27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:19:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ed55b4cc-9c10-44d5-aaeb-bb5a57d30f27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:19:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ed55b4cc-9c10-44d5-aaeb-bb5a57d30f27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:19:21 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:19:21 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:19:21 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Apr 29 17:19:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ed55b4cc-9c10-44d5-aaeb-bb5a57d30f27 tempest-ServerRescueNegativeTestJSON-1326654837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.648s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:19:21 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-ed55b4cc-9c10-44d5-aaeb-bb5a57d30f27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:19:21 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ed55b4cc-9c10-44d5-aaeb-bb5a57d30f27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Deleted volume successfully. Apr 29 17:19:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ed55b4cc-9c10-44d5-aaeb-bb5a57d30f27 tempest-ServerRescueNegativeTestJSON-1326654837 None] Lock "cinder-9f2c21a9-4515-4581-af2c-01338db1cbb7-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:19:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0da57a6c-a9df-428e-bcce-4dc9aaef753f tempest-ServerStableDeviceRescueTest-508512582 None] Acquiring lock "cinder-68f40b90-f156-4d4b-97c1-3c62ecc4146c-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:19:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0da57a6c-a9df-428e-bcce-4dc9aaef753f tempest-ServerStableDeviceRescueTest-508512582 None] Lock "cinder-68f40b90-f156-4d4b-97c1-3c62ecc4146c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:19:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0da57a6c-a9df-428e-bcce-4dc9aaef753f tempest-ServerStableDeviceRescueTest-508512582 None] Acquiring lock "cinder-quobyte-68f40b90-f156-4d4b-97c1-3c62ecc4146c" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:19:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0da57a6c-a9df-428e-bcce-4dc9aaef753f tempest-ServerStableDeviceRescueTest-508512582 None] Lock "cinder-quobyte-68f40b90-f156-4d4b-97c1-3c62ecc4146c" acquired by "delete_volume" :: waited 0.014s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:19:26 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c4a62f-3399-4825-b3b9-30bbc8091ff8]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:19:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0da57a6c-a9df-428e-bcce-4dc9aaef753f tempest-ServerStableDeviceRescueTest-508512582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68f40b90-f156-4d4b-97c1-3c62ecc4146c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:19:26 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68f40b90-f156-4d4b-97c1-3c62ecc4146c Apr 29 17:19:26 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:19:26 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Apr 29 17:19:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0da57a6c-a9df-428e-bcce-4dc9aaef753f tempest-ServerStableDeviceRescueTest-508512582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68f40b90-f156-4d4b-97c1-3c62ecc4146c" returned: 0 in 0.756s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:19:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0da57a6c-a9df-428e-bcce-4dc9aaef753f tempest-ServerStableDeviceRescueTest-508512582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68f40b90-f156-4d4b-97c1-3c62ecc4146c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:19:26 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68f40b90-f156-4d4b-97c1-3c62ecc4146c Apr 29 17:19:26 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:19:27 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Apr 29 17:19:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0da57a6c-a9df-428e-bcce-4dc9aaef753f tempest-ServerStableDeviceRescueTest-508512582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68f40b90-f156-4d4b-97c1-3c62ecc4146c" returned: 0 in 0.732s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:19:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0da57a6c-a9df-428e-bcce-4dc9aaef753f tempest-ServerStableDeviceRescueTest-508512582 None] Lock "cinder-quobyte-68f40b90-f156-4d4b-97c1-3c62ecc4146c" released by "delete_volume" :: held 1.532s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:19:27 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-0da57a6c-a9df-428e-bcce-4dc9aaef753f tempest-ServerStableDeviceRescueTest-508512582 None] Created reservations ['6c0e2b3e-9b3d-4d23-993f-1d956921aea7', 'fe240035-7192-4d14-98de-837a27f3deeb', '59d026ae-73bf-4a2f-b102-99b017f67705', 'd6fa2d41-59b9-497b-b91a-ec6c4f30dbe4'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:19:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0da57a6c-a9df-428e-bcce-4dc9aaef753f tempest-ServerStableDeviceRescueTest-508512582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:19:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0da57a6c-a9df-428e-bcce-4dc9aaef753f tempest-ServerStableDeviceRescueTest-508512582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:19:27 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0da57a6c-a9df-428e-bcce-4dc9aaef753f tempest-ServerStableDeviceRescueTest-508512582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:19:27 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0da57a6c-a9df-428e-bcce-4dc9aaef753f tempest-ServerStableDeviceRescueTest-508512582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:19:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0da57a6c-a9df-428e-bcce-4dc9aaef753f tempest-ServerStableDeviceRescueTest-508512582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:19:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0da57a6c-a9df-428e-bcce-4dc9aaef753f tempest-ServerStableDeviceRescueTest-508512582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:19:27 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:19:27 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:19:28 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Apr 29 17:19:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0da57a6c-a9df-428e-bcce-4dc9aaef753f tempest-ServerStableDeviceRescueTest-508512582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.715s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:19:28 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-0da57a6c-a9df-428e-bcce-4dc9aaef753f tempest-ServerStableDeviceRescueTest-508512582 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:19:28 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-0da57a6c-a9df-428e-bcce-4dc9aaef753f tempest-ServerStableDeviceRescueTest-508512582 None] Deleted volume successfully. Apr 29 17:19:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0da57a6c-a9df-428e-bcce-4dc9aaef753f tempest-ServerStableDeviceRescueTest-508512582 None] Lock "cinder-68f40b90-f156-4d4b-97c1-3c62ecc4146c-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Flow 'volume_create_manager' (f222bd2f-0f98-4587-b8f2-07887ffae330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a82f9b-f53f-4e4c-ae9a-1dca1b5510d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a82f9b-f53f-4e4c-ae9a-1dca1b5510d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2001033456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9c2df04-00ab-4a93-964d-af93ef1757d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757697e5832e410d946bafe668e93ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:19:30Z,use_quota=True,user_id='0ef4ba5e767a4b26b6279e5836013882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7323ca-4f9b-49d4-b4d1-f1b7bec456c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7323ca-4f9b-49d4-b4d1-f1b7bec456c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa7593b-2c30-46cc-bb29-128102d0129b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaa7593b-2c30-46cc-bb29-128102d0129b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9c2df04-00ab-4a93-964d-af93ef1757d4', 'volume_name': 'volume-c9c2df04-00ab-4a93-964d-af93ef1757d4', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51ec08e-adb4-42c8-a789-bc26b79c0834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51ec08e-adb4-42c8-a789-bc26b79c0834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4637ddf-8804-47bd-b374-e34835e27b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:19:29 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Volume c9c2df04-00ab-4a93-964d-af93ef1757d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9c2df04-00ab-4a93-964d-af93ef1757d4', 'volume_size': 1} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2001033456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9c2df04-00ab-4a93-964d-af93ef1757d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757697e5832e410d946bafe668e93ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:19:30Z,use_quota=True,user_id='0ef4ba5e767a4b26b6279e5836013882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Creating volume c9c2df04-00ab-4a93-964d-af93ef1757d4 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:19:29 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:19:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c9c2df04-00ab-4a93-964d-af93ef1757d4 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:19:29 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c9c2df04-00ab-4a93-964d-af93ef1757d4 1073741824 Apr 29 17:19:29 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:19:31 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Apr 29 17:19:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c9c2df04-00ab-4a93-964d-af93ef1757d4 1073741824" returned: 0 in 1.164s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:19:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c9c2df04-00ab-4a93-964d-af93ef1757d4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:19:31 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c9c2df04-00ab-4a93-964d-af93ef1757d4 Apr 29 17:19:31 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:19:31 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Apr 29 17:19:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c9c2df04-00ab-4a93-964d-af93ef1757d4" returned: 0 in 0.761s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:19:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] <== create_volume: return (1983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:19:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:19:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4637ddf-8804-47bd-b374-e34835e27b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9c2df04-00ab-4a93-964d-af93ef1757d4', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:19:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61b0e18-c845-4bd7-8d3b-4a1b7b45bc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:19:31 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Volume volume-c9c2df04-00ab-4a93-964d-af93ef1757d4 (c9c2df04-00ab-4a93-964d-af93ef1757d4): created successfully Apr 29 17:19:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b61b0e18-c845-4bd7-8d3b-4a1b7b45bc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:19:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Flow 'volume_create_manager' (f222bd2f-0f98-4587-b8f2-07887ffae330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:19:31 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e81b8ff7-e5a8-42eb-b4c8-d1ba24aade8e tempest-AttachVolumeTestJSON-602814825 None] Created volume successfully. Apr 29 17:19:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-59959571-e6c6-4266-96e8-6022fc31e068 req-2dbf0764-07e0-4017-970c-773c4f3cdb50 tempest-AttachVolumeTestJSON-602814825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:19:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-59959571-e6c6-4266-96e8-6022fc31e068 req-2dbf0764-07e0-4017-970c-773c4f3cdb50 tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:19:36 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b726567-55ea-4489-af89-3fb795df91fa]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:19:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-59959571-e6c6-4266-96e8-6022fc31e068 req-2dbf0764-07e0-4017-970c-773c4f3cdb50 tempest-AttachVolumeTestJSON-602814825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c9c2df04-00ab-4a93-964d-af93ef1757d4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:19:36 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c9c2df04-00ab-4a93-964d-af93ef1757d4 Apr 29 17:19:36 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:19:36 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Apr 29 17:19:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-59959571-e6c6-4266-96e8-6022fc31e068 req-2dbf0764-07e0-4017-970c-773c4f3cdb50 tempest-AttachVolumeTestJSON-602814825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c9c2df04-00ab-4a93-964d-af93ef1757d4" returned: 0 in 0.865s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:19:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-59959571-e6c6-4266-96e8-6022fc31e068 req-2dbf0764-07e0-4017-970c-773c4f3cdb50 tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.888s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:19:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-59959571-e6c6-4266-96e8-6022fc31e068 req-2dbf0764-07e0-4017-970c-773c4f3cdb50 tempest-AttachVolumeTestJSON-602814825 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-c9c2df04-00ab-4a93-964d-af93ef1757d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '456cdd6f-4240-428b-ae25-609458773932', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:19:37 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-59959571-e6c6-4266-96e8-6022fc31e068 req-2dbf0764-07e0-4017-970c-773c4f3cdb50 tempest-AttachVolumeTestJSON-602814825 None] attachment_update completed successfully. Apr 29 17:19:50 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=25,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=1 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:19:50 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=23,cinder:INSERT=6,cinder:UPDATE=30,cinder:DELETE=3 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Flow 'volume_create_manager' (6fabe1b5-ea45-4c7e-89d5-46c2d147f155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7deee2f6-67bc-4335-8965-b7050e4ef8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7deee2f6-67bc-4335-8965-b7050e4ef8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1603030894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9d5748-5ab6-4909-b3a5-f24e6746f020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a4d5ed3a34746f487ed82e41805f937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:19:57Z,use_quota=True,user_id='7896ab0b03644eab99968f9df7299cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc1eb41-8851-4b75-8d4a-592c4da0499c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc1eb41-8851-4b75-8d4a-592c4da0499c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b2a5a5-e4ea-4e50-99f5-a4765234c375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05b2a5a5-e4ea-4e50-99f5-a4765234c375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e9d5748-5ab6-4909-b3a5-f24e6746f020', 'volume_name': 'volume-4e9d5748-5ab6-4909-b3a5-f24e6746f020', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a318f75b-4613-4d07-8697-e35738bc9723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a318f75b-4613-4d07-8697-e35738bc9723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67889d7f-6028-4b16-a4e9-e6b41454c918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:19:57 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Volume 4e9d5748-5ab6-4909-b3a5-f24e6746f020: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e9d5748-5ab6-4909-b3a5-f24e6746f020', 'volume_size': 1} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1603030894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9d5748-5ab6-4909-b3a5-f24e6746f020,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a4d5ed3a34746f487ed82e41805f937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:19:57Z,use_quota=True,user_id='7896ab0b03644eab99968f9df7299cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Creating volume 4e9d5748-5ab6-4909-b3a5-f24e6746f020 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:19:57 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:19:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e9d5748-5ab6-4909-b3a5-f24e6746f020 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:19:57 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e9d5748-5ab6-4909-b3a5-f24e6746f020 1073741824 Apr 29 17:19:57 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:19:58 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Apr 29 17:19:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e9d5748-5ab6-4909-b3a5-f24e6746f020 1073741824" returned: 0 in 1.475s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:19:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e9d5748-5ab6-4909-b3a5-f24e6746f020 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:19:59 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e9d5748-5ab6-4909-b3a5-f24e6746f020 Apr 29 17:19:59 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:00 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e9d5748-5ab6-4909-b3a5-f24e6746f020" returned: 0 in 1.259s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] <== create_volume: return (2842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:20:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.845s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67889d7f-6028-4b16-a4e9-e6b41454c918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e9d5748-5ab6-4909-b3a5-f24e6746f020', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b1c3e9-4d31-4ca8-a78b-c2119eb2e115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:00 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Volume volume-4e9d5748-5ab6-4909-b3a5-f24e6746f020 (4e9d5748-5ab6-4909-b3a5-f24e6746f020): created successfully Apr 29 17:20:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b1c3e9-4d31-4ca8-a78b-c2119eb2e115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Flow 'volume_create_manager' (6fabe1b5-ea45-4c7e-89d5-46c2d147f155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:20:00 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-41e44c10-41d9-415a-b7e5-9120cfc595c1 tempest-VolumesActionsTest-113144169 None] Created volume successfully. Apr 29 17:20:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4449130a-f659-4328-aebb-404176a47552 tempest-VolumesActionsTest-113144169 None] Acquiring lock "cinder-4e9d5748-5ab6-4909-b3a5-f24e6746f020" by "attach_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:20:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4449130a-f659-4328-aebb-404176a47552 tempest-VolumesActionsTest-113144169 None] Lock "cinder-4e9d5748-5ab6-4909-b3a5-f24e6746f020" acquired by "attach_volume" :: waited 0.038s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:20:01 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4449130a-f659-4328-aebb-404176a47552 tempest-VolumesActionsTest-113144169 None] Attaching volume 4e9d5748-5ab6-4909-b3a5-f24e6746f020 to instance 5b3b4f77-77cb-49dd-b68c-be59382f0e63 at mountpoint /dev/vdb on host None. Apr 29 17:20:01 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4449130a-f659-4328-aebb-404176a47552 tempest-VolumesActionsTest-113144169 None] Attach volume completed successfully. Apr 29 17:20:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4449130a-f659-4328-aebb-404176a47552 tempest-VolumesActionsTest-113144169 None] Lock "cinder-4e9d5748-5ab6-4909-b3a5-f24e6746f020" released by "attach_volume" :: held 0.158s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:20:03 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4f54a3aa-4eb7-4ee4-bc3b-bd58082ffe2a tempest-VolumesActionsTest-1624053167 None] Terminate volume connection completed successfully. Apr 29 17:20:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4f54a3aa-4eb7-4ee4-bc3b-bd58082ffe2a tempest-VolumesActionsTest-1624053167 None] Acquiring lock "cinder-4e9d5748-5ab6-4909-b3a5-f24e6746f020-detach_volume" by "detach_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:20:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4f54a3aa-4eb7-4ee4-bc3b-bd58082ffe2a tempest-VolumesActionsTest-1624053167 None] Lock "cinder-4e9d5748-5ab6-4909-b3a5-f24e6746f020-detach_volume" acquired by "detach_volume" :: waited 0.066s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:20:03 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4f54a3aa-4eb7-4ee4-bc3b-bd58082ffe2a tempest-VolumesActionsTest-1624053167 None] Detaching volume 4e9d5748-5ab6-4909-b3a5-f24e6746f020 from instance 5b3b4f77-77cb-49dd-b68c-be59382f0e63. Apr 29 17:20:04 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4f54a3aa-4eb7-4ee4-bc3b-bd58082ffe2a tempest-VolumesActionsTest-1624053167 None] Detach volume completed successfully. Apr 29 17:20:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4f54a3aa-4eb7-4ee4-bc3b-bd58082ffe2a tempest-VolumesActionsTest-1624053167 None] Lock "cinder-4e9d5748-5ab6-4909-b3a5-f24e6746f020-detach_volume" released by "detach_volume" :: held 0.158s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:20:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3c927f17-0d67-41ff-b2c2-74d0340cb9fb tempest-VolumesActionsTest-113144169 None] Acquiring lock "cinder-4e9d5748-5ab6-4909-b3a5-f24e6746f020-detach_volume" by "detach_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:20:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3c927f17-0d67-41ff-b2c2-74d0340cb9fb tempest-VolumesActionsTest-113144169 None] Lock "cinder-4e9d5748-5ab6-4909-b3a5-f24e6746f020-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:20:04 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-3c927f17-0d67-41ff-b2c2-74d0340cb9fb tempest-VolumesActionsTest-113144169 None] Volume detach called, but volume not attached. Apr 29 17:20:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3c927f17-0d67-41ff-b2c2-74d0340cb9fb tempest-VolumesActionsTest-113144169 None] Lock "cinder-4e9d5748-5ab6-4909-b3a5-f24e6746f020-detach_volume" released by "detach_volume" :: held 0.038s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:20:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4b770b71-28fb-4d4e-826e-200a318b7443 tempest-VolumesActionsTest-113144169 None] Acquiring lock "cinder-4e9d5748-5ab6-4909-b3a5-f24e6746f020-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:20:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4b770b71-28fb-4d4e-826e-200a318b7443 tempest-VolumesActionsTest-113144169 None] Lock "cinder-4e9d5748-5ab6-4909-b3a5-f24e6746f020-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:20:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:20:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:20:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:20:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4b770b71-28fb-4d4e-826e-200a318b7443 tempest-VolumesActionsTest-113144169 None] Acquiring lock "cinder-quobyte-4e9d5748-5ab6-4909-b3a5-f24e6746f020" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:20:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4b770b71-28fb-4d4e-826e-200a318b7443 tempest-VolumesActionsTest-113144169 None] Lock "cinder-quobyte-4e9d5748-5ab6-4909-b3a5-f24e6746f020" acquired by "delete_volume" :: waited 0.032s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:20:05 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:20:05 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:05 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d14fa79-3efb-4478-83fa-b5fea2733ed2]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:20:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4b770b71-28fb-4d4e-826e-200a318b7443 tempest-VolumesActionsTest-113144169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e9d5748-5ab6-4909-b3a5-f24e6746f020 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:05 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e9d5748-5ab6-4909-b3a5-f24e6746f020 Apr 29 17:20:05 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:06 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.365s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:20:07 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4b770b71-28fb-4d4e-826e-200a318b7443 tempest-VolumesActionsTest-113144169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e9d5748-5ab6-4909-b3a5-f24e6746f020" returned: 0 in 1.903s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4b770b71-28fb-4d4e-826e-200a318b7443 tempest-VolumesActionsTest-113144169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e9d5748-5ab6-4909-b3a5-f24e6746f020 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:07 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e9d5748-5ab6-4909-b3a5-f24e6746f020 Apr 29 17:20:07 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:08 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4b770b71-28fb-4d4e-826e-200a318b7443 tempest-VolumesActionsTest-113144169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e9d5748-5ab6-4909-b3a5-f24e6746f020" returned: 0 in 1.139s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:08 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4b770b71-28fb-4d4e-826e-200a318b7443 tempest-VolumesActionsTest-113144169 None] Lock "cinder-quobyte-4e9d5748-5ab6-4909-b3a5-f24e6746f020" released by "delete_volume" :: held 3.130s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:20:08 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-4b770b71-28fb-4d4e-826e-200a318b7443 tempest-VolumesActionsTest-113144169 None] Created reservations ['164bc6f6-d446-4ae0-85de-c9eb9118742c', 'cfcbd2f4-145e-40ee-bfc7-1fe7509709dd', 'cd9c7698-e2b5-4606-8ad9-35d6cae10d26', 'c4f2b44d-f558-4b30-a5be-89ed4fb6c57e'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:20:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4b770b71-28fb-4d4e-826e-200a318b7443 tempest-VolumesActionsTest-113144169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4b770b71-28fb-4d4e-826e-200a318b7443 tempest-VolumesActionsTest-113144169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4b770b71-28fb-4d4e-826e-200a318b7443 tempest-VolumesActionsTest-113144169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:20:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4b770b71-28fb-4d4e-826e-200a318b7443 tempest-VolumesActionsTest-113144169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:20:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4b770b71-28fb-4d4e-826e-200a318b7443 tempest-VolumesActionsTest-113144169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4b770b71-28fb-4d4e-826e-200a318b7443 tempest-VolumesActionsTest-113144169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:09 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:20:09 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:09 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4b770b71-28fb-4d4e-826e-200a318b7443 tempest-VolumesActionsTest-113144169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.834s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:09 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-4b770b71-28fb-4d4e-826e-200a318b7443 tempest-VolumesActionsTest-113144169 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:20:09 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4b770b71-28fb-4d4e-826e-200a318b7443 tempest-VolumesActionsTest-113144169 None] Deleted volume successfully. Apr 29 17:20:09 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4b770b71-28fb-4d4e-826e-200a318b7443 tempest-VolumesActionsTest-113144169 None] Lock "cinder-4e9d5748-5ab6-4909-b3a5-f24e6746f020-delete_volume" released by "delete_volume" :: held 4.348s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:20:16 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:20:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Flow 'volume_create_manager' (46ed4c87-05e0-4672-ade0-34b6552c14e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:20:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1057f7d6-6a87-4e40-9d52-5df151c6e7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1057f7d6-6a87-4e40-9d52-5df151c6e7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1300626723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d8f5df-e293-47eb-a597-f2589ba7eab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a4d5ed3a34746f487ed82e41805f937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:20:17Z,use_quota=True,user_id='7896ab0b03644eab99968f9df7299cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32faab1b-9745-40bd-bc06-7d8a640198a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32faab1b-9745-40bd-bc06-7d8a640198a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4126561-7b9f-45f2-bad2-f7dd3de83903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4126561-7b9f-45f2-bad2-f7dd3de83903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8d8f5df-e293-47eb-a597-f2589ba7eab2', 'volume_name': 'volume-f8d8f5df-e293-47eb-a597-f2589ba7eab2', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d06b1a-80d1-4e37-9ff2-fb6ac8c33051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d06b1a-80d1-4e37-9ff2-fb6ac8c33051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8769905d-c7df-45b9-9a83-ae9a4885153f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:17 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Volume f8d8f5df-e293-47eb-a597-f2589ba7eab2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8d8f5df-e293-47eb-a597-f2589ba7eab2', 'volume_size': 1} Apr 29 17:20:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1300626723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8d8f5df-e293-47eb-a597-f2589ba7eab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a4d5ed3a34746f487ed82e41805f937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:20:17Z,use_quota=True,user_id='7896ab0b03644eab99968f9df7299cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:20:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Creating volume f8d8f5df-e293-47eb-a597-f2589ba7eab2 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:20:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:20:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:20:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:20:17 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:20:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f8d8f5df-e293-47eb-a597-f2589ba7eab2 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:17 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f8d8f5df-e293-47eb-a597-f2589ba7eab2 1073741824 Apr 29 17:20:17 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:18 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f8d8f5df-e293-47eb-a597-f2589ba7eab2 1073741824" returned: 0 in 0.993s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f8d8f5df-e293-47eb-a597-f2589ba7eab2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:18 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f8d8f5df-e293-47eb-a597-f2589ba7eab2 Apr 29 17:20:18 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:18 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f8d8f5df-e293-47eb-a597-f2589ba7eab2" returned: 0 in 0.666s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:20:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8769905d-c7df-45b9-9a83-ae9a4885153f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8d8f5df-e293-47eb-a597-f2589ba7eab2', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205bafc4-d36f-4dc7-9c63-d5beb38140ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:18 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Volume volume-f8d8f5df-e293-47eb-a597-f2589ba7eab2 (f8d8f5df-e293-47eb-a597-f2589ba7eab2): created successfully Apr 29 17:20:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205bafc4-d36f-4dc7-9c63-d5beb38140ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Flow 'volume_create_manager' (46ed4c87-05e0-4672-ade0-34b6552c14e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:20:18 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-133fbe78-a6eb-4040-a583-11f63621ecae tempest-VolumesActionsTest-113144169 None] Created volume successfully. Apr 29 17:20:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c4ce22f3-0946-46f5-a840-d10a6678b156 tempest-VolumesActionsTest-1624053167 None] Acquiring lock "cinder-f8d8f5df-e293-47eb-a597-f2589ba7eab2-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:20:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c4ce22f3-0946-46f5-a840-d10a6678b156 tempest-VolumesActionsTest-1624053167 None] Lock "cinder-f8d8f5df-e293-47eb-a597-f2589ba7eab2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:20:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c4ce22f3-0946-46f5-a840-d10a6678b156 tempest-VolumesActionsTest-1624053167 None] Acquiring lock "cinder-quobyte-f8d8f5df-e293-47eb-a597-f2589ba7eab2" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:20:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c4ce22f3-0946-46f5-a840-d10a6678b156 tempest-VolumesActionsTest-1624053167 None] Lock "cinder-quobyte-f8d8f5df-e293-47eb-a597-f2589ba7eab2" acquired by "delete_volume" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:20:19 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7942fd1-813d-484f-8eca-6443fcea632a]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:20:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c4ce22f3-0946-46f5-a840-d10a6678b156 tempest-VolumesActionsTest-1624053167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f8d8f5df-e293-47eb-a597-f2589ba7eab2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:19 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f8d8f5df-e293-47eb-a597-f2589ba7eab2 Apr 29 17:20:19 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:20 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c4ce22f3-0946-46f5-a840-d10a6678b156 tempest-VolumesActionsTest-1624053167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f8d8f5df-e293-47eb-a597-f2589ba7eab2" returned: 0 in 0.837s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c4ce22f3-0946-46f5-a840-d10a6678b156 tempest-VolumesActionsTest-1624053167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f8d8f5df-e293-47eb-a597-f2589ba7eab2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:20 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f8d8f5df-e293-47eb-a597-f2589ba7eab2 Apr 29 17:20:20 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:21 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c4ce22f3-0946-46f5-a840-d10a6678b156 tempest-VolumesActionsTest-1624053167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f8d8f5df-e293-47eb-a597-f2589ba7eab2" returned: 0 in 1.053s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c4ce22f3-0946-46f5-a840-d10a6678b156 tempest-VolumesActionsTest-1624053167 None] Lock "cinder-quobyte-f8d8f5df-e293-47eb-a597-f2589ba7eab2" released by "delete_volume" :: held 1.956s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:20:21 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-c4ce22f3-0946-46f5-a840-d10a6678b156 tempest-VolumesActionsTest-1624053167 None] Created reservations ['78810ecd-7af0-4b0d-af63-36c050283b0a', '4f0729aa-53e6-4436-9544-6ca9b782d4b1', '78c44edb-0258-410d-b62b-b1643aa8b60e', '67577af8-24cf-4c75-988d-0db500b0b4a7'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:20:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c4ce22f3-0946-46f5-a840-d10a6678b156 tempest-VolumesActionsTest-1624053167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c4ce22f3-0946-46f5-a840-d10a6678b156 tempest-VolumesActionsTest-1624053167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c4ce22f3-0946-46f5-a840-d10a6678b156 tempest-VolumesActionsTest-1624053167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:20:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c4ce22f3-0946-46f5-a840-d10a6678b156 tempest-VolumesActionsTest-1624053167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:20:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c4ce22f3-0946-46f5-a840-d10a6678b156 tempest-VolumesActionsTest-1624053167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c4ce22f3-0946-46f5-a840-d10a6678b156 tempest-VolumesActionsTest-1624053167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:21 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:20:21 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Flow 'volume_create_manager' (810437f9-0f9f-4a72-beb3-18758c0f8237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2581d49a-66f0-4490-9694-720280e3fc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2581d49a-66f0-4490-9694-720280e3fc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1072168715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2279cd1f-3f0e-4970-b4ce-3abfb635ad60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a4d5ed3a34746f487ed82e41805f937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:20:22Z,use_quota=True,user_id='7896ab0b03644eab99968f9df7299cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04806b06-ebb5-4eb2-b8ea-48238159f4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04806b06-ebb5-4eb2-b8ea-48238159f4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee30bcf-6302-4f66-9b86-631ce7422fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee30bcf-6302-4f66-9b86-631ce7422fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2279cd1f-3f0e-4970-b4ce-3abfb635ad60', 'volume_name': 'volume-2279cd1f-3f0e-4970-b4ce-3abfb635ad60', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c78a0f4-cf1b-493f-ab02-9a53bf195a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c78a0f4-cf1b-493f-ab02-9a53bf195a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83fc589-86e8-4888-8c13-0ec891c3125f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:22 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Volume 2279cd1f-3f0e-4970-b4ce-3abfb635ad60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2279cd1f-3f0e-4970-b4ce-3abfb635ad60', 'volume_size': 1} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1072168715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2279cd1f-3f0e-4970-b4ce-3abfb635ad60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a4d5ed3a34746f487ed82e41805f937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:20:22Z,use_quota=True,user_id='7896ab0b03644eab99968f9df7299cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Creating volume 2279cd1f-3f0e-4970-b4ce-3abfb635ad60 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:20:22 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2279cd1f-3f0e-4970-b4ce-3abfb635ad60 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:22 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2279cd1f-3f0e-4970-b4ce-3abfb635ad60 1073741824 Apr 29 17:20:22 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:22 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c4ce22f3-0946-46f5-a840-d10a6678b156 tempest-VolumesActionsTest-1624053167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.344s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-c4ce22f3-0946-46f5-a840-d10a6678b156 tempest-VolumesActionsTest-1624053167 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:20:22 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-c4ce22f3-0946-46f5-a840-d10a6678b156 tempest-VolumesActionsTest-1624053167 None] Deleted volume successfully. Apr 29 17:20:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c4ce22f3-0946-46f5-a840-d10a6678b156 tempest-VolumesActionsTest-1624053167 None] Lock "cinder-f8d8f5df-e293-47eb-a597-f2589ba7eab2-delete_volume" released by "delete_volume" :: held 3.678s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:20:24 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2279cd1f-3f0e-4970-b4ce-3abfb635ad60 1073741824" returned: 0 in 1.254s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2279cd1f-3f0e-4970-b4ce-3abfb635ad60 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:24 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2279cd1f-3f0e-4970-b4ce-3abfb635ad60 Apr 29 17:20:24 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:25 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2279cd1f-3f0e-4970-b4ce-3abfb635ad60" returned: 0 in 1.175s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:25 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] <== create_volume: return (2501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:20:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.506s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:25 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a83fc589-86e8-4888-8c13-0ec891c3125f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2279cd1f-3f0e-4970-b4ce-3abfb635ad60', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:25 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d46e274-dba6-4179-8da2-0b5cfa63134f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:25 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Volume volume-2279cd1f-3f0e-4970-b4ce-3abfb635ad60 (2279cd1f-3f0e-4970-b4ce-3abfb635ad60): created successfully Apr 29 17:20:25 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d46e274-dba6-4179-8da2-0b5cfa63134f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:25 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Flow 'volume_create_manager' (810437f9-0f9f-4a72-beb3-18758c0f8237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:20:25 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-8ad8f620-c0e8-418e-bcc4-1a734ae0e2a7 tempest-VolumesActionsTest-113144169 None] Created volume successfully. Apr 29 17:20:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-88e5b1b3-dff6-4bd1-a671-fbcb61030054 tempest-VolumesActionsTest-1624053167 None] Acquiring lock "cinder-2279cd1f-3f0e-4970-b4ce-3abfb635ad60-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:20:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-88e5b1b3-dff6-4bd1-a671-fbcb61030054 tempest-VolumesActionsTest-1624053167 None] Lock "cinder-2279cd1f-3f0e-4970-b4ce-3abfb635ad60-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:20:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-88e5b1b3-dff6-4bd1-a671-fbcb61030054 tempest-VolumesActionsTest-1624053167 None] Acquiring lock "cinder-quobyte-2279cd1f-3f0e-4970-b4ce-3abfb635ad60" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:20:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-88e5b1b3-dff6-4bd1-a671-fbcb61030054 tempest-VolumesActionsTest-1624053167 None] Lock "cinder-quobyte-2279cd1f-3f0e-4970-b4ce-3abfb635ad60" acquired by "delete_volume" :: waited 0.026s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:20:26 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca45421-42c8-4af7-b4d8-af6c2f3bd7c0]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:20:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-88e5b1b3-dff6-4bd1-a671-fbcb61030054 tempest-VolumesActionsTest-1624053167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2279cd1f-3f0e-4970-b4ce-3abfb635ad60 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:26 devstack sudo[98553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2279cd1f-3f0e-4970-b4ce-3abfb635ad60 Apr 29 17:20:26 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:27 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-88e5b1b3-dff6-4bd1-a671-fbcb61030054 tempest-VolumesActionsTest-1624053167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2279cd1f-3f0e-4970-b4ce-3abfb635ad60" returned: 0 in 0.844s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-88e5b1b3-dff6-4bd1-a671-fbcb61030054 tempest-VolumesActionsTest-1624053167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2279cd1f-3f0e-4970-b4ce-3abfb635ad60 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:27 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2279cd1f-3f0e-4970-b4ce-3abfb635ad60 Apr 29 17:20:27 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:27 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-88e5b1b3-dff6-4bd1-a671-fbcb61030054 tempest-VolumesActionsTest-1624053167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2279cd1f-3f0e-4970-b4ce-3abfb635ad60" returned: 0 in 0.759s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-88e5b1b3-dff6-4bd1-a671-fbcb61030054 tempest-VolumesActionsTest-1624053167 None] Lock "cinder-quobyte-2279cd1f-3f0e-4970-b4ce-3abfb635ad60" released by "delete_volume" :: held 1.656s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:20:28 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-88e5b1b3-dff6-4bd1-a671-fbcb61030054 tempest-VolumesActionsTest-1624053167 None] Created reservations ['363ef554-5e10-4a73-8df8-0abc8bf46147', '5a9b1139-5a5d-4517-b214-3e517cd7ab83', '6e8e42cc-9d1c-4019-8216-74a2d26777e6', 'f8f902c2-3c09-436f-8029-305b0a92f2f1'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:20:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-88e5b1b3-dff6-4bd1-a671-fbcb61030054 tempest-VolumesActionsTest-1624053167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-88e5b1b3-dff6-4bd1-a671-fbcb61030054 tempest-VolumesActionsTest-1624053167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-88e5b1b3-dff6-4bd1-a671-fbcb61030054 tempest-VolumesActionsTest-1624053167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:20:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-88e5b1b3-dff6-4bd1-a671-fbcb61030054 tempest-VolumesActionsTest-1624053167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:20:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-88e5b1b3-dff6-4bd1-a671-fbcb61030054 tempest-VolumesActionsTest-1624053167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-88e5b1b3-dff6-4bd1-a671-fbcb61030054 tempest-VolumesActionsTest-1624053167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:28 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:20:28 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:28 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-88e5b1b3-dff6-4bd1-a671-fbcb61030054 tempest-VolumesActionsTest-1624053167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.853s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:28 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-88e5b1b3-dff6-4bd1-a671-fbcb61030054 tempest-VolumesActionsTest-1624053167 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:20:29 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-88e5b1b3-dff6-4bd1-a671-fbcb61030054 tempest-VolumesActionsTest-1624053167 None] Deleted volume successfully. Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-88e5b1b3-dff6-4bd1-a671-fbcb61030054 tempest-VolumesActionsTest-1624053167 None] Lock "cinder-2279cd1f-3f0e-4970-b4ce-3abfb635ad60-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Flow 'volume_create_manager' (5aa63564-9f5d-42cc-9ec5-94ee08b29346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972d423b-f581-4e8c-b73a-cb7018ac39eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972d423b-f581-4e8c-b73a-cb7018ac39eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-445635776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e40eae9-352d-4b5a-a988-99cfa8422811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a4d5ed3a34746f487ed82e41805f937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:20:29Z,use_quota=True,user_id='7896ab0b03644eab99968f9df7299cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d865f97-1675-4ce6-964d-854a66e02219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d865f97-1675-4ce6-964d-854a66e02219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9b1b64-3e72-4461-8bf0-5c7b140a514d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9b1b64-3e72-4461-8bf0-5c7b140a514d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e40eae9-352d-4b5a-a988-99cfa8422811', 'volume_name': 'volume-2e40eae9-352d-4b5a-a988-99cfa8422811', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e916c9-bad9-4306-9211-134a91d849b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e916c9-bad9-4306-9211-134a91d849b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b743e9-f1ad-41b3-89d9-ec02ac567891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:29 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Volume 2e40eae9-352d-4b5a-a988-99cfa8422811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e40eae9-352d-4b5a-a988-99cfa8422811', 'volume_size': 1} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-445635776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e40eae9-352d-4b5a-a988-99cfa8422811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a4d5ed3a34746f487ed82e41805f937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:20:29Z,use_quota=True,user_id='7896ab0b03644eab99968f9df7299cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Creating volume 2e40eae9-352d-4b5a-a988-99cfa8422811 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:20:29 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:20:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2e40eae9-352d-4b5a-a988-99cfa8422811 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:29 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2e40eae9-352d-4b5a-a988-99cfa8422811 1073741824 Apr 29 17:20:29 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:30 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-1b8cb0e2-d5a6-4a3f-be1c-e59b3e976557 req-917b7ea4-aea2-4637-a078-26c2d40bd6be tempest-AttachVolumeTestJSON-602814825 None] Terminate volume connection completed successfully. Apr 29 17:20:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-1b8cb0e2-d5a6-4a3f-be1c-e59b3e976557 req-917b7ea4-aea2-4637-a078-26c2d40bd6be tempest-AttachVolumeTestJSON-602814825 None] Deleting attachment 456cdd6f-4240-428b-ae25-609458773932. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:20:30 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2e40eae9-352d-4b5a-a988-99cfa8422811 1073741824" returned: 0 in 1.422s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2e40eae9-352d-4b5a-a988-99cfa8422811 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:30 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2e40eae9-352d-4b5a-a988-99cfa8422811 Apr 29 17:20:30 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:31 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2e40eae9-352d-4b5a-a988-99cfa8422811" returned: 0 in 0.737s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] <== create_volume: return (2232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:20:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.236s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b743e9-f1ad-41b3-89d9-ec02ac567891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e40eae9-352d-4b5a-a988-99cfa8422811', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da51edb9-6762-4d00-8eea-578ce5486e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:31 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Volume volume-2e40eae9-352d-4b5a-a988-99cfa8422811 (2e40eae9-352d-4b5a-a988-99cfa8422811): created successfully Apr 29 17:20:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da51edb9-6762-4d00-8eea-578ce5486e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Flow 'volume_create_manager' (5aa63564-9f5d-42cc-9ec5-94ee08b29346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:20:31 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-5af3204b-cad6-4425-8899-c25533e5e635 tempest-VolumesActionsTest-113144169 None] Created volume successfully. Apr 29 17:20:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c92d9b3b-2582-402c-b2fd-85fefefc39f1 tempest-VolumesActionsTest-1624053167 None] Acquiring lock "cinder-2e40eae9-352d-4b5a-a988-99cfa8422811-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:20:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c92d9b3b-2582-402c-b2fd-85fefefc39f1 tempest-VolumesActionsTest-1624053167 None] Lock "cinder-2e40eae9-352d-4b5a-a988-99cfa8422811-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:20:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c92d9b3b-2582-402c-b2fd-85fefefc39f1 tempest-VolumesActionsTest-1624053167 None] Acquiring lock "cinder-quobyte-2e40eae9-352d-4b5a-a988-99cfa8422811" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:20:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c92d9b3b-2582-402c-b2fd-85fefefc39f1 tempest-VolumesActionsTest-1624053167 None] Lock "cinder-quobyte-2e40eae9-352d-4b5a-a988-99cfa8422811" acquired by "delete_volume" :: waited 0.041s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:20:32 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[831d5dbe-317e-4c95-b4a1-76d786fb602c]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:20:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c92d9b3b-2582-402c-b2fd-85fefefc39f1 tempest-VolumesActionsTest-1624053167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2e40eae9-352d-4b5a-a988-99cfa8422811 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:32 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2e40eae9-352d-4b5a-a988-99cfa8422811 Apr 29 17:20:32 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:34 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c92d9b3b-2582-402c-b2fd-85fefefc39f1 tempest-VolumesActionsTest-1624053167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2e40eae9-352d-4b5a-a988-99cfa8422811" returned: 0 in 1.488s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c92d9b3b-2582-402c-b2fd-85fefefc39f1 tempest-VolumesActionsTest-1624053167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2e40eae9-352d-4b5a-a988-99cfa8422811 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:34 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2e40eae9-352d-4b5a-a988-99cfa8422811 Apr 29 17:20:34 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:35 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c92d9b3b-2582-402c-b2fd-85fefefc39f1 tempest-VolumesActionsTest-1624053167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2e40eae9-352d-4b5a-a988-99cfa8422811" returned: 0 in 1.159s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:35 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c92d9b3b-2582-402c-b2fd-85fefefc39f1 tempest-VolumesActionsTest-1624053167 None] Lock "cinder-quobyte-2e40eae9-352d-4b5a-a988-99cfa8422811" released by "delete_volume" :: held 2.811s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:20:35 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-c92d9b3b-2582-402c-b2fd-85fefefc39f1 tempest-VolumesActionsTest-1624053167 None] Created reservations ['79ff9b35-a561-49b6-91d4-6a084104388b', '78abe587-caa7-4522-8148-67565c8a806c', '55601cb1-43a5-4c33-8f03-56c633fb47ee', '40c14f5e-5b03-411d-976a-d88e1a74c020'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:20:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c92d9b3b-2582-402c-b2fd-85fefefc39f1 tempest-VolumesActionsTest-1624053167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c92d9b3b-2582-402c-b2fd-85fefefc39f1 tempest-VolumesActionsTest-1624053167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:35 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c92d9b3b-2582-402c-b2fd-85fefefc39f1 tempest-VolumesActionsTest-1624053167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:20:35 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c92d9b3b-2582-402c-b2fd-85fefefc39f1 tempest-VolumesActionsTest-1624053167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:20:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c92d9b3b-2582-402c-b2fd-85fefefc39f1 tempest-VolumesActionsTest-1624053167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c92d9b3b-2582-402c-b2fd-85fefefc39f1 tempest-VolumesActionsTest-1624053167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:35 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:20:35 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:37 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c92d9b3b-2582-402c-b2fd-85fefefc39f1 tempest-VolumesActionsTest-1624053167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 2.016s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:37 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-c92d9b3b-2582-402c-b2fd-85fefefc39f1 tempest-VolumesActionsTest-1624053167 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:20:37 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-c92d9b3b-2582-402c-b2fd-85fefefc39f1 tempest-VolumesActionsTest-1624053167 None] Deleted volume successfully. Apr 29 17:20:37 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c92d9b3b-2582-402c-b2fd-85fefefc39f1 tempest-VolumesActionsTest-1624053167 None] Lock "cinder-2e40eae9-352d-4b5a-a988-99cfa8422811-delete_volume" released by "delete_volume" :: held 5.323s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Flow 'volume_create_manager' (c7354bee-2983-4781-98d8-fc564329fdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40bafda7-170e-4b2b-8a97-c369b4bb7140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40bafda7-170e-4b2b-8a97-c369b4bb7140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1709692418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a4d5ed3a34746f487ed82e41805f937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:20:38Z,use_quota=True,user_id='7896ab0b03644eab99968f9df7299cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a23fa5-c8ae-4f02-a898-de89777f66df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a23fa5-c8ae-4f02-a898-de89777f66df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f3a4764-7015-46d0-a365-0cf7544ff313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f3a4764-7015-46d0-a365-0cf7544ff313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec', 'volume_name': 'volume-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (621cab5c-e187-42c1-aed3-ee2d06345437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (621cab5c-e187-42c1-aed3-ee2d06345437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd8bb34-7b02-4d8c-95e6-a24602c578a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:38 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Volume 7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec', 'volume_size': 1} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1709692418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a4d5ed3a34746f487ed82e41805f937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:20:38Z,use_quota=True,user_id='7896ab0b03644eab99968f9df7299cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Creating volume 7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:20:38 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:20:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:38 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec 1073741824 Apr 29 17:20:38 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:39 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec 1073741824" returned: 0 in 1.512s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:39 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec Apr 29 17:20:39 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:40 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec" returned: 0 in 0.825s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] <== create_volume: return (2430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:20:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.434s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bd8bb34-7b02-4d8c-95e6-a24602c578a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f1616b-5b85-4a81-93d3-a440151e89f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:40 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Volume volume-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec (7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec): created successfully Apr 29 17:20:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f1616b-5b85-4a81-93d3-a440151e89f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Flow 'volume_create_manager' (c7354bee-2983-4781-98d8-fc564329fdb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:20:40 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-c25d21d3-3b25-4f4f-ab35-1b8063f04742 tempest-VolumesActionsTest-113144169 None] Created volume successfully. Apr 29 17:20:41 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e81db309-e0bc-4f0a-96fc-7aa2bfda60ea tempest-VolumesActionsTest-1624053167 None] Acquiring lock "cinder-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:20:41 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e81db309-e0bc-4f0a-96fc-7aa2bfda60ea tempest-VolumesActionsTest-1624053167 None] Lock "cinder-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:20:41 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e81db309-e0bc-4f0a-96fc-7aa2bfda60ea tempest-VolumesActionsTest-1624053167 None] Acquiring lock "cinder-quobyte-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:20:41 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e81db309-e0bc-4f0a-96fc-7aa2bfda60ea tempest-VolumesActionsTest-1624053167 None] Lock "cinder-quobyte-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec" acquired by "delete_volume" :: waited 0.029s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:20:41 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[438be439-52e3-4af3-a33e-4067694aa5de]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:20:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e81db309-e0bc-4f0a-96fc-7aa2bfda60ea tempest-VolumesActionsTest-1624053167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:41 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec Apr 29 17:20:41 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:42 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e81db309-e0bc-4f0a-96fc-7aa2bfda60ea tempest-VolumesActionsTest-1624053167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec" returned: 0 in 0.840s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e81db309-e0bc-4f0a-96fc-7aa2bfda60ea tempest-VolumesActionsTest-1624053167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:42 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec Apr 29 17:20:42 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:43 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e81db309-e0bc-4f0a-96fc-7aa2bfda60ea tempest-VolumesActionsTest-1624053167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec" returned: 0 in 0.689s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:43 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e81db309-e0bc-4f0a-96fc-7aa2bfda60ea tempest-VolumesActionsTest-1624053167 None] Lock "cinder-quobyte-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec" released by "delete_volume" :: held 1.584s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:20:43 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-e81db309-e0bc-4f0a-96fc-7aa2bfda60ea tempest-VolumesActionsTest-1624053167 None] Created reservations ['45135b27-de58-4961-af0b-9ec4d2a3b378', 'ae392108-2fa5-47a8-a43f-e65a39193687', 'fdc23de8-99c4-48dd-9870-381e1ed421c4', '3e133225-842b-413f-9666-b90f56e1a3e9'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:20:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e81db309-e0bc-4f0a-96fc-7aa2bfda60ea tempest-VolumesActionsTest-1624053167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e81db309-e0bc-4f0a-96fc-7aa2bfda60ea tempest-VolumesActionsTest-1624053167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:43 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e81db309-e0bc-4f0a-96fc-7aa2bfda60ea tempest-VolumesActionsTest-1624053167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:20:43 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e81db309-e0bc-4f0a-96fc-7aa2bfda60ea tempest-VolumesActionsTest-1624053167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:20:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e81db309-e0bc-4f0a-96fc-7aa2bfda60ea tempest-VolumesActionsTest-1624053167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e81db309-e0bc-4f0a-96fc-7aa2bfda60ea tempest-VolumesActionsTest-1624053167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:43 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:20:43 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:44 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e81db309-e0bc-4f0a-96fc-7aa2bfda60ea tempest-VolumesActionsTest-1624053167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.765s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-e81db309-e0bc-4f0a-96fc-7aa2bfda60ea tempest-VolumesActionsTest-1624053167 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:20:44 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e81db309-e0bc-4f0a-96fc-7aa2bfda60ea tempest-VolumesActionsTest-1624053167 None] Deleted volume successfully. Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e81db309-e0bc-4f0a-96fc-7aa2bfda60ea tempest-VolumesActionsTest-1624053167 None] Lock "cinder-7e8cbf04-8ca2-4b15-b9c9-2d042e42bdec-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Flow 'volume_create_manager' (fcbdb8e2-7f04-4389-9be5-f30cb9c4a358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d06976c-f099-464c-9f35-7255b389baab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d06976c-f099-464c-9f35-7255b389baab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1954279143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb118e4-ccb1-4393-a3c5-db76360e6638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a4d5ed3a34746f487ed82e41805f937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:20:44Z,use_quota=True,user_id='7896ab0b03644eab99968f9df7299cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936118c3-0aea-44f1-9775-e69baa349a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936118c3-0aea-44f1-9775-e69baa349a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df849a4-386d-4f07-b57c-74d6a1d34ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df849a4-386d-4f07-b57c-74d6a1d34ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cb118e4-ccb1-4393-a3c5-db76360e6638', 'volume_name': 'volume-7cb118e4-ccb1-4393-a3c5-db76360e6638', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc87054d-ea2f-436a-8a46-cab317ac8f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc87054d-ea2f-436a-8a46-cab317ac8f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4790b705-5037-4750-8830-94b3a62e8923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:44 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Volume 7cb118e4-ccb1-4393-a3c5-db76360e6638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cb118e4-ccb1-4393-a3c5-db76360e6638', 'volume_size': 1} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1954279143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cb118e4-ccb1-4393-a3c5-db76360e6638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a4d5ed3a34746f487ed82e41805f937',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:20:44Z,use_quota=True,user_id='7896ab0b03644eab99968f9df7299cdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Creating volume 7cb118e4-ccb1-4393-a3c5-db76360e6638 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:20:44 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:20:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7cb118e4-ccb1-4393-a3c5-db76360e6638 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:44 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7cb118e4-ccb1-4393-a3c5-db76360e6638 1073741824 Apr 29 17:20:44 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:45 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7cb118e4-ccb1-4393-a3c5-db76360e6638 1073741824" returned: 0 in 0.943s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7cb118e4-ccb1-4393-a3c5-db76360e6638 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:45 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7cb118e4-ccb1-4393-a3c5-db76360e6638 Apr 29 17:20:45 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:46 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7cb118e4-ccb1-4393-a3c5-db76360e6638" returned: 0 in 0.980s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:20:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4790b705-5037-4750-8830-94b3a62e8923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cb118e4-ccb1-4393-a3c5-db76360e6638', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc4fad1-d4eb-4075-af67-03dfde0b709b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:46 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Volume volume-7cb118e4-ccb1-4393-a3c5-db76360e6638 (7cb118e4-ccb1-4393-a3c5-db76360e6638): created successfully Apr 29 17:20:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc4fad1-d4eb-4075-af67-03dfde0b709b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Flow 'volume_create_manager' (fcbdb8e2-7f04-4389-9be5-f30cb9c4a358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:20:46 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e7b5b387-59c9-439c-a174-36990746e3e7 tempest-VolumesActionsTest-113144169 None] Created volume successfully. Apr 29 17:20:47 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:20:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Flow 'volume_create_manager' (544f5822-e022-42e4-bd1a-0ac423bb44bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:20:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1c50a1-0aa1-414b-82a6-e64b0b707750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1c50a1-0aa1-414b-82a6-e64b0b707750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1800292678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47e4d91-3841-485a-9fbd-29b054e3093f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b828cdcdad149098189494e1cd0a30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:20:48Z,use_quota=True,user_id='43c1ec7e4fe64e868cd4aef7d06dac0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c8b716-a162-46dd-bab8-a078fb0c3b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3c8b716-a162-46dd-bab8-a078fb0c3b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a68380-1e22-4eab-8397-c8957259e09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37a68380-1e22-4eab-8397-c8957259e09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd47e4d91-3841-485a-9fbd-29b054e3093f', 'volume_name': 'volume-d47e4d91-3841-485a-9fbd-29b054e3093f', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31404572-a80b-4458-b01d-4def89f2721c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31404572-a80b-4458-b01d-4def89f2721c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8eb243-c279-421c-bd0a-bd07a8f15cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:48 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Volume d47e4d91-3841-485a-9fbd-29b054e3093f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d47e4d91-3841-485a-9fbd-29b054e3093f', 'volume_size': 1} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1800292678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47e4d91-3841-485a-9fbd-29b054e3093f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b828cdcdad149098189494e1cd0a30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:20:48Z,use_quota=True,user_id='43c1ec7e4fe64e868cd4aef7d06dac0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Creating volume d47e4d91-3841-485a-9fbd-29b054e3093f {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:20:48 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d47e4d91-3841-485a-9fbd-29b054e3093f 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:48 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d47e4d91-3841-485a-9fbd-29b054e3093f 1073741824 Apr 29 17:20:48 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f017b75d-0dc5-47cb-bcbf-7e836b775ebc tempest-VolumesActionsTest-113144169 None] Acquiring lock "cinder-7cb118e4-ccb1-4393-a3c5-db76360e6638-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f017b75d-0dc5-47cb-bcbf-7e836b775ebc tempest-VolumesActionsTest-113144169 None] Lock "cinder-7cb118e4-ccb1-4393-a3c5-db76360e6638-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f017b75d-0dc5-47cb-bcbf-7e836b775ebc tempest-VolumesActionsTest-113144169 None] Acquiring lock "cinder-quobyte-7cb118e4-ccb1-4393-a3c5-db76360e6638" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f017b75d-0dc5-47cb-bcbf-7e836b775ebc tempest-VolumesActionsTest-113144169 None] Lock "cinder-quobyte-7cb118e4-ccb1-4393-a3c5-db76360e6638" acquired by "delete_volume" :: waited 0.028s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92a8ed3-b4c1-406d-a0a8-e35a2b77c59c]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:20:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f017b75d-0dc5-47cb-bcbf-7e836b775ebc tempest-VolumesActionsTest-113144169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7cb118e4-ccb1-4393-a3c5-db76360e6638 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:48 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7cb118e4-ccb1-4393-a3c5-db76360e6638 Apr 29 17:20:48 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:49 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d47e4d91-3841-485a-9fbd-29b054e3093f 1073741824" returned: 0 in 1.004s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d47e4d91-3841-485a-9fbd-29b054e3093f {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:49 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d47e4d91-3841-485a-9fbd-29b054e3093f Apr 29 17:20:49 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:49 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f017b75d-0dc5-47cb-bcbf-7e836b775ebc tempest-VolumesActionsTest-113144169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7cb118e4-ccb1-4393-a3c5-db76360e6638" returned: 0 in 0.913s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f017b75d-0dc5-47cb-bcbf-7e836b775ebc tempest-VolumesActionsTest-113144169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7cb118e4-ccb1-4393-a3c5-db76360e6638 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:49 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7cb118e4-ccb1-4393-a3c5-db76360e6638 Apr 29 17:20:49 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:49 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d47e4d91-3841-485a-9fbd-29b054e3093f" returned: 0 in 0.682s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:49 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:20:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:49 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8eb243-c279-421c-bd0a-bd07a8f15cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d47e4d91-3841-485a-9fbd-29b054e3093f', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:49 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62866629-ba7f-419c-b112-2d1e5b34cf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:49 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Volume volume-d47e4d91-3841-485a-9fbd-29b054e3093f (d47e4d91-3841-485a-9fbd-29b054e3093f): created successfully Apr 29 17:20:49 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62866629-ba7f-419c-b112-2d1e5b34cf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:49 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Flow 'volume_create_manager' (544f5822-e022-42e4-bd1a-0ac423bb44bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:20:49 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-16bbe1b1-89f6-499b-b201-c39ed880a8fa tempest-ServersNegativeTestJSON-1289084141 None] Created volume successfully. Apr 29 17:20:50 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f017b75d-0dc5-47cb-bcbf-7e836b775ebc tempest-VolumesActionsTest-113144169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7cb118e4-ccb1-4393-a3c5-db76360e6638" returned: 0 in 0.689s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:50 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f017b75d-0dc5-47cb-bcbf-7e836b775ebc tempest-VolumesActionsTest-113144169 None] Lock "cinder-quobyte-7cb118e4-ccb1-4393-a3c5-db76360e6638" released by "delete_volume" :: held 1.658s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:20:50 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-f017b75d-0dc5-47cb-bcbf-7e836b775ebc tempest-VolumesActionsTest-113144169 None] Created reservations ['2f1fff16-64d2-4d6f-b028-2837f90a7270', 'c7510533-1866-4c98-bac9-0ead5c45c5e9', '8b87e3fc-384c-4fd4-bb09-bb1c37d22f98', '9e0de4d7-59a8-4b98-85b6-e63f836247e2'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:20:50 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=71,cinder:SELECT=46,cinder:INSERT=16,cinder:DELETE=6 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:20:50 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=59,cinder:UPDATE=71,cinder:DELETE=6,cinder:INSERT=17 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:20:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f017b75d-0dc5-47cb-bcbf-7e836b775ebc tempest-VolumesActionsTest-113144169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f017b75d-0dc5-47cb-bcbf-7e836b775ebc tempest-VolumesActionsTest-113144169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f017b75d-0dc5-47cb-bcbf-7e836b775ebc tempest-VolumesActionsTest-113144169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:20:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f017b75d-0dc5-47cb-bcbf-7e836b775ebc tempest-VolumesActionsTest-113144169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:20:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f017b75d-0dc5-47cb-bcbf-7e836b775ebc tempest-VolumesActionsTest-113144169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f017b75d-0dc5-47cb-bcbf-7e836b775ebc tempest-VolumesActionsTest-113144169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:50 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:20:50 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Flow 'volume_create_manager' (486417fb-b4f7-483e-b051-d19aa92fadd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b51054f-a991-4dbc-a04c-eb28235ff311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:51 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f017b75d-0dc5-47cb-bcbf-7e836b775ebc tempest-VolumesActionsTest-113144169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.996s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-f017b75d-0dc5-47cb-bcbf-7e836b775ebc tempest-VolumesActionsTest-113144169 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b51054f-a991-4dbc-a04c-eb28235ff311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-728602529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8535eb26-5678-4bf5-925a-276d04824ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b828cdcdad149098189494e1cd0a30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:20:51Z,use_quota=True,user_id='43c1ec7e4fe64e868cd4aef7d06dac0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3931c3d1-9911-4b68-bb1d-fd252c8321a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3931c3d1-9911-4b68-bb1d-fd252c8321a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07100cc-6415-4233-9523-610293d4e4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07100cc-6415-4233-9523-610293d4e4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8535eb26-5678-4bf5-925a-276d04824ace', 'volume_name': 'volume-8535eb26-5678-4bf5-925a-276d04824ace', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49edda20-542c-4ba1-b658-705072a2f8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49edda20-542c-4ba1-b658-705072a2f8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dbe19e6-bba9-44e6-950d-28940b0aa323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:51 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Volume 8535eb26-5678-4bf5-925a-276d04824ace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8535eb26-5678-4bf5-925a-276d04824ace', 'volume_size': 1} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-728602529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8535eb26-5678-4bf5-925a-276d04824ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b828cdcdad149098189494e1cd0a30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:20:51Z,use_quota=True,user_id='43c1ec7e4fe64e868cd4aef7d06dac0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Creating volume 8535eb26-5678-4bf5-925a-276d04824ace {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:20:51 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8535eb26-5678-4bf5-925a-276d04824ace 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:51 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f017b75d-0dc5-47cb-bcbf-7e836b775ebc tempest-VolumesActionsTest-113144169 None] Deleted volume successfully. Apr 29 17:20:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f017b75d-0dc5-47cb-bcbf-7e836b775ebc tempest-VolumesActionsTest-113144169 None] Lock "cinder-7cb118e4-ccb1-4393-a3c5-db76360e6638-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:20:51 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8535eb26-5678-4bf5-925a-276d04824ace 1073741824 Apr 29 17:20:51 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:53 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8535eb26-5678-4bf5-925a-276d04824ace 1073741824" returned: 0 in 1.615s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8535eb26-5678-4bf5-925a-276d04824ace {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:53 devstack sudo[99035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8535eb26-5678-4bf5-925a-276d04824ace Apr 29 17:20:53 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:54 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8535eb26-5678-4bf5-925a-276d04824ace" returned: 0 in 0.873s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] <== create_volume: return (2543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:20:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.546s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dbe19e6-bba9-44e6-950d-28940b0aa323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8535eb26-5678-4bf5-925a-276d04824ace', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffaf3d9-a3ce-4e22-8f5b-574d9a027bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:54 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Volume volume-8535eb26-5678-4bf5-925a-276d04824ace (8535eb26-5678-4bf5-925a-276d04824ace): created successfully Apr 29 17:20:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffaf3d9-a3ce-4e22-8f5b-574d9a027bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Flow 'volume_create_manager' (486417fb-b4f7-483e-b051-d19aa92fadd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:20:54 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-92aba39e-65af-438c-99b4-367ace16c6bf tempest-ServersNegativeTestJSON-1289084141 None] Created volume successfully. Apr 29 17:20:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-baf1d0d6-fb79-4048-96d7-4770ca56beb3 tempest-ServersNegativeTestJSON-1289084141 None] Acquiring lock "cinder-8535eb26-5678-4bf5-925a-276d04824ace-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:20:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-baf1d0d6-fb79-4048-96d7-4770ca56beb3 tempest-ServersNegativeTestJSON-1289084141 None] Lock "cinder-8535eb26-5678-4bf5-925a-276d04824ace-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:20:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-baf1d0d6-fb79-4048-96d7-4770ca56beb3 tempest-ServersNegativeTestJSON-1289084141 None] Acquiring lock "cinder-quobyte-8535eb26-5678-4bf5-925a-276d04824ace" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:20:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-baf1d0d6-fb79-4048-96d7-4770ca56beb3 tempest-ServersNegativeTestJSON-1289084141 None] Lock "cinder-quobyte-8535eb26-5678-4bf5-925a-276d04824ace" acquired by "delete_volume" :: waited 0.028s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:20:55 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dac69f4-facd-46a6-a87b-9a8439feb1d1]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:20:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-baf1d0d6-fb79-4048-96d7-4770ca56beb3 tempest-ServersNegativeTestJSON-1289084141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8535eb26-5678-4bf5-925a-276d04824ace {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:55 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8535eb26-5678-4bf5-925a-276d04824ace Apr 29 17:20:55 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:56 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-baf1d0d6-fb79-4048-96d7-4770ca56beb3 tempest-ServersNegativeTestJSON-1289084141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8535eb26-5678-4bf5-925a-276d04824ace" returned: 0 in 0.900s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-baf1d0d6-fb79-4048-96d7-4770ca56beb3 tempest-ServersNegativeTestJSON-1289084141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8535eb26-5678-4bf5-925a-276d04824ace {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:56 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8535eb26-5678-4bf5-925a-276d04824ace Apr 29 17:20:56 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:57 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-baf1d0d6-fb79-4048-96d7-4770ca56beb3 tempest-ServersNegativeTestJSON-1289084141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8535eb26-5678-4bf5-925a-276d04824ace" returned: 0 in 0.692s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-baf1d0d6-fb79-4048-96d7-4770ca56beb3 tempest-ServersNegativeTestJSON-1289084141 None] Lock "cinder-quobyte-8535eb26-5678-4bf5-925a-276d04824ace" released by "delete_volume" :: held 1.652s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:20:57 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-baf1d0d6-fb79-4048-96d7-4770ca56beb3 tempest-ServersNegativeTestJSON-1289084141 None] Created reservations ['65f2d992-559f-407a-bb7e-655ec3b8742e', '4714fb27-d03c-4646-9342-e560089495ee', 'c642776b-cc53-431c-9ee1-4f23873fbb9d', '2ab00b04-d184-4a03-bc74-69e50882ab6e'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:20:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-baf1d0d6-fb79-4048-96d7-4770ca56beb3 tempest-ServersNegativeTestJSON-1289084141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-baf1d0d6-fb79-4048-96d7-4770ca56beb3 tempest-ServersNegativeTestJSON-1289084141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:57 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-baf1d0d6-fb79-4048-96d7-4770ca56beb3 tempest-ServersNegativeTestJSON-1289084141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:20:57 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-baf1d0d6-fb79-4048-96d7-4770ca56beb3 tempest-ServersNegativeTestJSON-1289084141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:20:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-baf1d0d6-fb79-4048-96d7-4770ca56beb3 tempest-ServersNegativeTestJSON-1289084141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-baf1d0d6-fb79-4048-96d7-4770ca56beb3 tempest-ServersNegativeTestJSON-1289084141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:57 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:20:57 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f8135c11-2814-456b-bda1-eb6495cfc293 tempest-ServersNegativeTestJSON-1289084141 None] Acquiring lock "cinder-d47e4d91-3841-485a-9fbd-29b054e3093f-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:20:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f8135c11-2814-456b-bda1-eb6495cfc293 tempest-ServersNegativeTestJSON-1289084141 None] Lock "cinder-d47e4d91-3841-485a-9fbd-29b054e3093f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:20:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f8135c11-2814-456b-bda1-eb6495cfc293 tempest-ServersNegativeTestJSON-1289084141 None] Acquiring lock "cinder-quobyte-d47e4d91-3841-485a-9fbd-29b054e3093f" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:20:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f8135c11-2814-456b-bda1-eb6495cfc293 tempest-ServersNegativeTestJSON-1289084141 None] Lock "cinder-quobyte-d47e4d91-3841-485a-9fbd-29b054e3093f" acquired by "delete_volume" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:20:57 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd985e8-55b6-4871-bd7b-6c07c4eca58d]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:20:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f8135c11-2814-456b-bda1-eb6495cfc293 tempest-ServersNegativeTestJSON-1289084141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d47e4d91-3841-485a-9fbd-29b054e3093f {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:57 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-baf1d0d6-fb79-4048-96d7-4770ca56beb3 tempest-ServersNegativeTestJSON-1289084141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.725s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:58 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-baf1d0d6-fb79-4048-96d7-4770ca56beb3 tempest-ServersNegativeTestJSON-1289084141 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:20:58 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-baf1d0d6-fb79-4048-96d7-4770ca56beb3 tempest-ServersNegativeTestJSON-1289084141 None] Deleted volume successfully. Apr 29 17:20:58 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d47e4d91-3841-485a-9fbd-29b054e3093f Apr 29 17:20:58 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-baf1d0d6-fb79-4048-96d7-4770ca56beb3 tempest-ServersNegativeTestJSON-1289084141 None] Lock "cinder-8535eb26-5678-4bf5-925a-276d04824ace-delete_volume" released by "delete_volume" :: held 2.676s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:20:58 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f8135c11-2814-456b-bda1-eb6495cfc293 tempest-ServersNegativeTestJSON-1289084141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d47e4d91-3841-485a-9fbd-29b054e3093f" returned: 0 in 1.018s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f8135c11-2814-456b-bda1-eb6495cfc293 tempest-ServersNegativeTestJSON-1289084141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d47e4d91-3841-485a-9fbd-29b054e3093f {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:58 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d47e4d91-3841-485a-9fbd-29b054e3093f Apr 29 17:20:58 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Flow 'volume_create_manager' (462323cf-fbda-4d07-9cb5-a3ccce653fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a36c4a6-99d3-42c7-933f-e8f7e37cc102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a36c4a6-99d3-42c7-933f-e8f7e37cc102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-649183046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230152d01a90428689e7ad853468358c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:20:59Z,use_quota=True,user_id='c5b8845014094fc881fca75dfdf94bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2785ee7f-33f5-4f41-87e7-ca4bdb195879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2785ee7f-33f5-4f41-87e7-ca4bdb195879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cfee33c-c03b-4a43-877c-2132292f8bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cfee33c-c03b-4a43-877c-2132292f8bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d', 'volume_name': 'volume-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb0ec44-81c7-4376-8276-5ede26ad4cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbb0ec44-81c7-4376-8276-5ede26ad4cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f3f990-95b4-4948-b07f-be9c8ec7db8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:20:59 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Volume 83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d', 'volume_size': 1} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:20:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-649183046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230152d01a90428689e7ad853468358c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:20:59Z,use_quota=True,user_id='c5b8845014094fc881fca75dfdf94bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Creating volume 83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:20:59 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:20:59 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d 1073741824 Apr 29 17:20:59 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:20:59 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f8135c11-2814-456b-bda1-eb6495cfc293 tempest-ServersNegativeTestJSON-1289084141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d47e4d91-3841-485a-9fbd-29b054e3093f" returned: 0 in 0.872s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f8135c11-2814-456b-bda1-eb6495cfc293 tempest-ServersNegativeTestJSON-1289084141 None] Lock "cinder-quobyte-d47e4d91-3841-485a-9fbd-29b054e3093f" released by "delete_volume" :: held 1.949s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:20:59 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-f8135c11-2814-456b-bda1-eb6495cfc293 tempest-ServersNegativeTestJSON-1289084141 None] Created reservations ['aa88c55f-3613-4e4b-818b-750a197b40b7', 'edce8bf5-9d53-44c5-8a60-f59c849ae6de', '25e74d0e-6a5d-4027-b197-18654bda32b2', 'b3d66df6-6264-4fe3-a2df-3f350d9ee7b3'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:21:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f8135c11-2814-456b-bda1-eb6495cfc293 tempest-ServersNegativeTestJSON-1289084141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f8135c11-2814-456b-bda1-eb6495cfc293 tempest-ServersNegativeTestJSON-1289084141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f8135c11-2814-456b-bda1-eb6495cfc293 tempest-ServersNegativeTestJSON-1289084141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:21:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f8135c11-2814-456b-bda1-eb6495cfc293 tempest-ServersNegativeTestJSON-1289084141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:21:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f8135c11-2814-456b-bda1-eb6495cfc293 tempest-ServersNegativeTestJSON-1289084141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f8135c11-2814-456b-bda1-eb6495cfc293 tempest-ServersNegativeTestJSON-1289084141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:00 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:21:00 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:00 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d 1073741824" returned: 0 in 1.186s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:00 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d Apr 29 17:21:00 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:00 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f8135c11-2814-456b-bda1-eb6495cfc293 tempest-ServersNegativeTestJSON-1289084141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.707s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:00 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-f8135c11-2814-456b-bda1-eb6495cfc293 tempest-ServersNegativeTestJSON-1289084141 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:21:00 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f8135c11-2814-456b-bda1-eb6495cfc293 tempest-ServersNegativeTestJSON-1289084141 None] Deleted volume successfully. Apr 29 17:21:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f8135c11-2814-456b-bda1-eb6495cfc293 tempest-ServersNegativeTestJSON-1289084141 None] Lock "cinder-d47e4d91-3841-485a-9fbd-29b054e3093f-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:21:01 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d" returned: 0 in 0.731s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:21:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.988s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f3f990-95b4-4948-b07f-be9c8ec7db8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300d8fb1-035d-4508-93e8-286aa77eb070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:01 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Volume volume-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d (83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d): created successfully Apr 29 17:21:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300d8fb1-035d-4508-93e8-286aa77eb070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Flow 'volume_create_manager' (462323cf-fbda-4d07-9cb5-a3ccce653fe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:21:01 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ee2924f1-3ae5-4602-855c-511b76f7877c tempest-AttachVolumeShelveTestJSON-737584018 None] Created volume successfully. Apr 29 17:21:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:21:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:21:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:21:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:05 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:21:05 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:06 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.708s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Flow 'volume_create_manager' (d57e4714-bedf-4500-8d31-2ebcebac64eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3aba7a-4f01-43c4-b018-6d4b07bc1f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3aba7a-4f01-43c4-b018-6d4b07bc1f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-945296900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a667b02b-f1e1-4a3a-b8b0-febcb28098f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf5bb5005464889bf9dff8e50ab419e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:21:06Z,use_quota=True,user_id='571a777313064b239fe3391ebbb183ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c6ab6c-ab4f-4f6b-97fe-16146611a4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c6ab6c-ab4f-4f6b-97fe-16146611a4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de89a21-7c13-40a9-96ce-d9806efa9cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de89a21-7c13-40a9-96ce-d9806efa9cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a667b02b-f1e1-4a3a-b8b0-febcb28098f2', 'volume_name': 'volume-a667b02b-f1e1-4a3a-b8b0-febcb28098f2', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f52166c-3a0a-4326-8b07-f82636a0e138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f52166c-3a0a-4326-8b07-f82636a0e138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7621548-707d-4bc7-9619-cfa653b4a30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:06 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Volume a667b02b-f1e1-4a3a-b8b0-febcb28098f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a667b02b-f1e1-4a3a-b8b0-febcb28098f2', 'volume_size': 1} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-945296900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a667b02b-f1e1-4a3a-b8b0-febcb28098f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf5bb5005464889bf9dff8e50ab419e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:21:06Z,use_quota=True,user_id='571a777313064b239fe3391ebbb183ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Creating volume a667b02b-f1e1-4a3a-b8b0-febcb28098f2 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:21:06 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:21:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a667b02b-f1e1-4a3a-b8b0-febcb28098f2 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:06 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a667b02b-f1e1-4a3a-b8b0-febcb28098f2 1073741824 Apr 29 17:21:06 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:07 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a667b02b-f1e1-4a3a-b8b0-febcb28098f2 1073741824" returned: 0 in 0.845s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a667b02b-f1e1-4a3a-b8b0-febcb28098f2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:07 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a667b02b-f1e1-4a3a-b8b0-febcb28098f2 Apr 29 17:21:07 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:08 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a667b02b-f1e1-4a3a-b8b0-febcb28098f2" returned: 0 in 0.930s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:21:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7621548-707d-4bc7-9619-cfa653b4a30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a667b02b-f1e1-4a3a-b8b0-febcb28098f2', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1da0900-48c6-4226-a548-306ffcdef27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:08 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Volume volume-a667b02b-f1e1-4a3a-b8b0-febcb28098f2 (a667b02b-f1e1-4a3a-b8b0-febcb28098f2): created successfully Apr 29 17:21:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1da0900-48c6-4226-a548-306ffcdef27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Flow 'volume_create_manager' (d57e4714-bedf-4500-8d31-2ebcebac64eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:21:08 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-b34ca42d-7808-4f13-a8f7-939cc420df1c tempest-VolumesListAdminTestJSON-1282505341 None] Created volume successfully. Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Flow 'volume_create_manager' (dc08a3a7-e06a-4623-b056-953dcf95f87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb27e296-5466-4a5c-9e46-62fb72eb1be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb27e296-5466-4a5c-9e46-62fb72eb1be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1540183158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0179010-b930-469f-a894-1aee34f15444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf5bb5005464889bf9dff8e50ab419e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:21:09Z,use_quota=True,user_id='571a777313064b239fe3391ebbb183ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27868b2e-968a-43c1-aaa5-f1e2e89e64bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27868b2e-968a-43c1-aaa5-f1e2e89e64bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287b1782-f343-40ee-9a21-ff9bcf5fad7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287b1782-f343-40ee-9a21-ff9bcf5fad7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0179010-b930-469f-a894-1aee34f15444', 'volume_name': 'volume-d0179010-b930-469f-a894-1aee34f15444', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd33700-4a72-4088-8060-773569c460da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd33700-4a72-4088-8060-773569c460da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48034429-9c08-483c-b0c1-01d70f1713bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:09 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Volume d0179010-b930-469f-a894-1aee34f15444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0179010-b930-469f-a894-1aee34f15444', 'volume_size': 1} Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1540183158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0179010-b930-469f-a894-1aee34f15444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf5bb5005464889bf9dff8e50ab419e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:21:09Z,use_quota=True,user_id='571a777313064b239fe3391ebbb183ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Creating volume d0179010-b930-469f-a894-1aee34f15444 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:21:09 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:21:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d0179010-b930-469f-a894-1aee34f15444 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:09 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d0179010-b930-469f-a894-1aee34f15444 1073741824 Apr 29 17:21:09 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:10 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d0179010-b930-469f-a894-1aee34f15444 1073741824" returned: 0 in 1.038s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d0179010-b930-469f-a894-1aee34f15444 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:10 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d0179010-b930-469f-a894-1aee34f15444 Apr 29 17:21:10 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:11 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d0179010-b930-469f-a894-1aee34f15444" returned: 0 in 1.263s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] <== create_volume: return (2366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:21:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.369s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48034429-9c08-483c-b0c1-01d70f1713bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0179010-b930-469f-a894-1aee34f15444', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7267cca-3e98-4038-9feb-6ec6ed6a47db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:11 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Volume volume-d0179010-b930-469f-a894-1aee34f15444 (d0179010-b930-469f-a894-1aee34f15444): created successfully Apr 29 17:21:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7267cca-3e98-4038-9feb-6ec6ed6a47db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Flow 'volume_create_manager' (dc08a3a7-e06a-4623-b056-953dcf95f87b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:21:11 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d122c2fa-57ae-4f42-b731-7a21d0f1e5be tempest-VolumesListAdminTestJSON-1282505341 None] Created volume successfully. Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Flow 'volume_create_manager' (4c4689b9-45b4-4dbd-887c-d76d51433f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c791a44-d451-430c-af2c-72a293d77e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c791a44-d451-430c-af2c-72a293d77e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1176434390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6107b6d1-f671-442e-98f9-28474d929523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf5bb5005464889bf9dff8e50ab419e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:21:13Z,use_quota=True,user_id='571a777313064b239fe3391ebbb183ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252e4cf4-5c89-4266-b476-bffaf13be0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252e4cf4-5c89-4266-b476-bffaf13be0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4139b753-b9fc-4287-9293-35877bbd824d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4139b753-b9fc-4287-9293-35877bbd824d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6107b6d1-f671-442e-98f9-28474d929523', 'volume_name': 'volume-6107b6d1-f671-442e-98f9-28474d929523', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c1322a-a127-4ec3-87dd-6a6daadaf060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c1322a-a127-4ec3-87dd-6a6daadaf060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82db95d3-55c2-4c87-8851-de112430a1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:13 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Volume 6107b6d1-f671-442e-98f9-28474d929523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6107b6d1-f671-442e-98f9-28474d929523', 'volume_size': 1} Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1176434390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6107b6d1-f671-442e-98f9-28474d929523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bf5bb5005464889bf9dff8e50ab419e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:21:13Z,use_quota=True,user_id='571a777313064b239fe3391ebbb183ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Creating volume 6107b6d1-f671-442e-98f9-28474d929523 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:21:13 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:21:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6107b6d1-f671-442e-98f9-28474d929523 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:13 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6107b6d1-f671-442e-98f9-28474d929523 1073741824 Apr 29 17:21:13 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:14 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6107b6d1-f671-442e-98f9-28474d929523 1073741824" returned: 0 in 0.939s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6107b6d1-f671-442e-98f9-28474d929523 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:14 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6107b6d1-f671-442e-98f9-28474d929523 Apr 29 17:21:14 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:14 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6107b6d1-f671-442e-98f9-28474d929523" returned: 0 in 0.623s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:21:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82db95d3-55c2-4c87-8851-de112430a1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6107b6d1-f671-442e-98f9-28474d929523', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a166698-61d0-412f-813a-c9143c6fd6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:14 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Volume volume-6107b6d1-f671-442e-98f9-28474d929523 (6107b6d1-f671-442e-98f9-28474d929523): created successfully Apr 29 17:21:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a166698-61d0-412f-813a-c9143c6fd6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Flow 'volume_create_manager' (4c4689b9-45b4-4dbd-887c-d76d51433f69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:21:14 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-12fe2f27-350f-4c03-b7dc-e2b7ae690511 tempest-VolumesListAdminTestJSON-1282505341 None] Created volume successfully. Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Flow 'volume_create_manager' (440f6f07-ee02-4cc9-8289-df2fff6b750a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7ecbbe-1821-4fe7-bc41-bcd950f16e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee7ecbbe-1821-4fe7-bc41-bcd950f16e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0b7539-a785-4948-8045-d5d1b7761ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500759ce5f6d46bfa845a6fded26b617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:21:16Z,use_quota=True,user_id='bfb5c9d8f713424ca303d45cba5b63db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0faef945-b382-4015-b7bd-278b4e6a3d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0faef945-b382-4015-b7bd-278b4e6a3d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5702c9ac-9161-4b53-9f36-07dcdd4a6b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5702c9ac-9161-4b53-9f36-07dcdd4a6b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d0b7539-a785-4948-8045-d5d1b7761ef6', 'volume_name': 'volume-7d0b7539-a785-4948-8045-d5d1b7761ef6', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd04185-505d-4afe-8113-b6152a25c3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd04185-505d-4afe-8113-b6152a25c3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f441ed-24ab-49f1-8a22-819faea1c4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:16 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Volume 7d0b7539-a785-4948-8045-d5d1b7761ef6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d0b7539-a785-4948-8045-d5d1b7761ef6', 'volume_size': 1} Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0b7539-a785-4948-8045-d5d1b7761ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500759ce5f6d46bfa845a6fded26b617',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:21:16Z,use_quota=True,user_id='bfb5c9d8f713424ca303d45cba5b63db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Creating volume 7d0b7539-a785-4948-8045-d5d1b7761ef6 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:21:16 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:21:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7d0b7539-a785-4948-8045-d5d1b7761ef6 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:16 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7d0b7539-a785-4948-8045-d5d1b7761ef6 1073741824 Apr 29 17:21:16 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:16 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-77fb708b-7dd7-4ba6-b7d6-aff54849cbc2 tempest-GroupSnapshotsTest-1478505142 None] Group tempest-GroupSnapshotsTest-Group-1072759209: creating Apr 29 17:21:16 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-77fb708b-7dd7-4ba6-b7d6-aff54849cbc2 tempest-GroupSnapshotsTest-1478505142 None] Group tempest-GroupSnapshotsTest-Group-1072759209: created successfully Apr 29 17:21:16 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-77fb708b-7dd7-4ba6-b7d6-aff54849cbc2 tempest-GroupSnapshotsTest-1478505142 None] Create group completed successfully. Apr 29 17:21:17 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7d0b7539-a785-4948-8045-d5d1b7761ef6 1073741824" returned: 0 in 0.987s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7d0b7539-a785-4948-8045-d5d1b7761ef6 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:17 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7d0b7539-a785-4948-8045-d5d1b7761ef6 Apr 29 17:21:17 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:21:18 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Flow 'volume_create_manager' (c5765006-6574-402a-8b4a-3d70ea8543e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b31ee3-6fcb-4596-af92-dcde6238ca68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7d0b7539-a785-4948-8045-d5d1b7761ef6" returned: 0 in 0.867s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b31ee3-6fcb-4596-af92-dcde6238ca68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1572835729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54e57658-c397-4d5e-b7a9-aa52c5ef5f49,host='devstack@QuobyteHD#QuobyteHD',id=6c3caade-99f7-406a-a44e-a8850ca97a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f11acad828d4ee2aa016f60ecda733d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:21:18Z,use_quota=True,user_id='5f9a5af157254c67ab571291e3ba3fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c6bdf8-6d3e-47d1-ae1b-bfe0631d1fa0),volume_type_id=84c6bdf8-6d3e-47d1-ae1b-bfe0631d1fa0)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986c8605-ccd2-42f3-a593-df7a2528a4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986c8605-ccd2-42f3-a593-df7a2528a4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6400056-bb13-4eac-a314-84489b891c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6400056-bb13-4eac-a314-84489b891c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c3caade-99f7-406a-a44e-a8850ca97a00', 'volume_name': 'volume-6c3caade-99f7-406a-a44e-a8850ca97a00', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15cec510-b9dc-44fc-a17f-b305efb2074e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15cec510-b9dc-44fc-a17f-b305efb2074e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305117e4-adb3-407d-a290-2d1251736a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:18 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Volume 6c3caade-99f7-406a-a44e-a8850ca97a00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c3caade-99f7-406a-a44e-a8850ca97a00', 'volume_size': 1} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=54e57658-c397-4d5e-b7a9-aa52c5ef5f49,created_at=2026-04-29T15:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1572835729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54e57658-c397-4d5e-b7a9-aa52c5ef5f49,host='devstack@QuobyteHD#QuobyteHD',id=6c3caade-99f7-406a-a44e-a8850ca97a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f11acad828d4ee2aa016f60ecda733d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:21:18Z,use_quota=True,user_id='5f9a5af157254c67ab571291e3ba3fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c6bdf8-6d3e-47d1-ae1b-bfe0631d1fa0),volume_type_id=84c6bdf8-6d3e-47d1-ae1b-bfe0631d1fa0)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Creating volume 6c3caade-99f7-406a-a44e-a8850ca97a00 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:21:18 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f441ed-24ab-49f1-8a22-819faea1c4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d0b7539-a785-4948-8045-d5d1b7761ef6', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:18 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 1073741824 Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d33b2ec-adee-4379-9c04-d9f768f42e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:18 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:18 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Volume volume-7d0b7539-a785-4948-8045-d5d1b7761ef6 (7d0b7539-a785-4948-8045-d5d1b7761ef6): created successfully Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d33b2ec-adee-4379-9c04-d9f768f42e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:18 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Flow 'volume_create_manager' (440f6f07-ee02-4cc9-8289-df2fff6b750a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:21:18 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-93fc2088-4ade-42c5-96be-b3493d8917d3 tempest-VolumesListAdminTestJSON-1299081675 None] Created volume successfully. Apr 29 17:21:19 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 1073741824" returned: 0 in 1.003s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:19 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 Apr 29 17:21:19 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0ab64898-fda5-45f2-9eb6-d8d75d630b0c tempest-VolumesListAdminTestJSON-1299081675 None] Acquiring lock "cinder-7d0b7539-a785-4948-8045-d5d1b7761ef6-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:21:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0ab64898-fda5-45f2-9eb6-d8d75d630b0c tempest-VolumesListAdminTestJSON-1299081675 None] Lock "cinder-7d0b7539-a785-4948-8045-d5d1b7761ef6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:21:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0ab64898-fda5-45f2-9eb6-d8d75d630b0c tempest-VolumesListAdminTestJSON-1299081675 None] Acquiring lock "cinder-quobyte-7d0b7539-a785-4948-8045-d5d1b7761ef6" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:21:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0ab64898-fda5-45f2-9eb6-d8d75d630b0c tempest-VolumesListAdminTestJSON-1299081675 None] Lock "cinder-quobyte-7d0b7539-a785-4948-8045-d5d1b7761ef6" acquired by "delete_volume" :: waited 0.026s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:21:19 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[f639d394-94df-45d5-b7ec-586d11fab9d5]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:21:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0ab64898-fda5-45f2-9eb6-d8d75d630b0c tempest-VolumesListAdminTestJSON-1299081675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7d0b7539-a785-4948-8045-d5d1b7761ef6 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-39a9664a-cbfa-48c2-a558-472392fa40a7 tempest-VolumesListAdminTestJSON-1282505341 None] Acquiring lock "cinder-6107b6d1-f671-442e-98f9-28474d929523-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:21:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-39a9664a-cbfa-48c2-a558-472392fa40a7 tempest-VolumesListAdminTestJSON-1282505341 None] Lock "cinder-6107b6d1-f671-442e-98f9-28474d929523-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:21:19 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7d0b7539-a785-4948-8045-d5d1b7761ef6 Apr 29 17:21:19 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-39a9664a-cbfa-48c2-a558-472392fa40a7 tempest-VolumesListAdminTestJSON-1282505341 None] Acquiring lock "cinder-quobyte-6107b6d1-f671-442e-98f9-28474d929523" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:21:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-39a9664a-cbfa-48c2-a558-472392fa40a7 tempest-VolumesListAdminTestJSON-1282505341 None] Lock "cinder-quobyte-6107b6d1-f671-442e-98f9-28474d929523" acquired by "delete_volume" :: waited 0.038s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:21:20 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[783eca4a-4d9e-4c0d-86c0-fd7379d8de35]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:21:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-39a9664a-cbfa-48c2-a558-472392fa40a7 tempest-VolumesListAdminTestJSON-1282505341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6107b6d1-f671-442e-98f9-28474d929523 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:20 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00" returned: 0 in 0.969s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:20 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6107b6d1-f671-442e-98f9-28474d929523 Apr 29 17:21:20 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:20 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] <== create_volume: return (2053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:21:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.056s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (305117e4-adb3-407d-a290-2d1251736a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c3caade-99f7-406a-a44e-a8850ca97a00', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd88ac1-eb52-4d64-91e0-f3fcbeb43eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:20 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Volume volume-6c3caade-99f7-406a-a44e-a8850ca97a00 (6c3caade-99f7-406a-a44e-a8850ca97a00): created successfully Apr 29 17:21:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd88ac1-eb52-4d64-91e0-f3fcbeb43eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Flow 'volume_create_manager' (c5765006-6574-402a-8b4a-3d70ea8543e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:21:20 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-8c4b4489-856b-4c8c-92f8-add5c9ea022a tempest-GroupSnapshotsTest-1478505142 None] Created volume successfully. Apr 29 17:21:20 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0ab64898-fda5-45f2-9eb6-d8d75d630b0c tempest-VolumesListAdminTestJSON-1299081675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7d0b7539-a785-4948-8045-d5d1b7761ef6" returned: 0 in 1.112s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0ab64898-fda5-45f2-9eb6-d8d75d630b0c tempest-VolumesListAdminTestJSON-1299081675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7d0b7539-a785-4948-8045-d5d1b7761ef6 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:20 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7d0b7539-a785-4948-8045-d5d1b7761ef6 Apr 29 17:21:20 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:21 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-39a9664a-cbfa-48c2-a558-472392fa40a7 tempest-VolumesListAdminTestJSON-1282505341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6107b6d1-f671-442e-98f9-28474d929523" returned: 0 in 1.002s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-39a9664a-cbfa-48c2-a558-472392fa40a7 tempest-VolumesListAdminTestJSON-1282505341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6107b6d1-f671-442e-98f9-28474d929523 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:21 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6107b6d1-f671-442e-98f9-28474d929523 Apr 29 17:21:21 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:21 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0ab64898-fda5-45f2-9eb6-d8d75d630b0c tempest-VolumesListAdminTestJSON-1299081675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7d0b7539-a785-4948-8045-d5d1b7761ef6" returned: 0 in 0.765s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0ab64898-fda5-45f2-9eb6-d8d75d630b0c tempest-VolumesListAdminTestJSON-1299081675 None] Lock "cinder-quobyte-7d0b7539-a785-4948-8045-d5d1b7761ef6" released by "delete_volume" :: held 1.958s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:21:21 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-39a9664a-cbfa-48c2-a558-472392fa40a7 tempest-VolumesListAdminTestJSON-1282505341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6107b6d1-f671-442e-98f9-28474d929523" returned: 0 in 0.693s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-39a9664a-cbfa-48c2-a558-472392fa40a7 tempest-VolumesListAdminTestJSON-1282505341 None] Lock "cinder-quobyte-6107b6d1-f671-442e-98f9-28474d929523" released by "delete_volume" :: held 1.751s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:21:22 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-0ab64898-fda5-45f2-9eb6-d8d75d630b0c tempest-VolumesListAdminTestJSON-1299081675 None] Created reservations ['357410e1-b12b-47b4-8f34-fddcf2c6b115', '33cf221d-616c-4e09-80ff-4af09a057bcf', '3d4dd972-7868-4c42-aaff-169d9a33f2b9', '8ea4bb18-cf44-4d5c-aecf-8392de1a67f9'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:21:22 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-39a9664a-cbfa-48c2-a558-472392fa40a7 tempest-VolumesListAdminTestJSON-1282505341 None] Created reservations ['c9247776-ebd0-4c25-a9df-b4389c1ad66a', '71e1015f-a22c-46c9-bcb3-58a89ea32b2e', '7d757b30-fe57-4641-8936-f781a39eff55', 'c1f96068-3c98-4b00-8e21-ff89a13538ca'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:21:27 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] GroupSnapshot c58a7c8c-0097-4a55-821d-aa82597a1421: creating. Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] Group snapshot c58a7c8c-0097-4a55-821d-aa82597a1421: creating. {{(pid=84547) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0ab64898-fda5-45f2-9eb6-d8d75d630b0c tempest-VolumesListAdminTestJSON-1299081675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0ab64898-fda5-45f2-9eb6-d8d75d630b0c tempest-VolumesListAdminTestJSON-1299081675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0ab64898-fda5-45f2-9eb6-d8d75d630b0c tempest-VolumesListAdminTestJSON-1299081675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0ab64898-fda5-45f2-9eb6-d8d75d630b0c tempest-VolumesListAdminTestJSON-1299081675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0ab64898-fda5-45f2-9eb6-d8d75d630b0c tempest-VolumesListAdminTestJSON-1299081675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0ab64898-fda5-45f2-9eb6-d8d75d630b0c tempest-VolumesListAdminTestJSON-1299081675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-39a9664a-cbfa-48c2-a558-472392fa40a7 tempest-VolumesListAdminTestJSON-1282505341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-39a9664a-cbfa-48c2-a558-472392fa40a7 tempest-VolumesListAdminTestJSON-1282505341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-39a9664a-cbfa-48c2-a558-472392fa40a7 tempest-VolumesListAdminTestJSON-1282505341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-39a9664a-cbfa-48c2-a558-472392fa40a7 tempest-VolumesListAdminTestJSON-1282505341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-39a9664a-cbfa-48c2-a558-472392fa40a7 tempest-VolumesListAdminTestJSON-1282505341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-39a9664a-cbfa-48c2-a558-472392fa40a7 tempest-VolumesListAdminTestJSON-1282505341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:28 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:21:28 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:28 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:21:28 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] Creating offline snapshot aa53166e-723b-4dcb-9b77-5d54b1d44b3e of volume 6c3caade-99f7-406a-a44e-a8850ca97a00 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce34203-9cab-4d03-8893-352cabd532d5]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:28 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 Apr 29 17:21:28 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:28 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0ab64898-fda5-45f2-9eb6-d8d75d630b0c tempest-VolumesListAdminTestJSON-1299081675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.743s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-0ab64898-fda5-45f2-9eb6-d8d75d630b0c tempest-VolumesListAdminTestJSON-1299081675 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:21:28 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-0ab64898-fda5-45f2-9eb6-d8d75d630b0c tempest-VolumesListAdminTestJSON-1299081675 None] Deleted volume successfully. Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0ab64898-fda5-45f2-9eb6-d8d75d630b0c tempest-VolumesListAdminTestJSON-1299081675 None] Lock "cinder-7d0b7539-a785-4948-8045-d5d1b7761ef6-delete_volume" released by "delete_volume" :: held 9.200s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:21:28 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-39a9664a-cbfa-48c2-a558-472392fa40a7 tempest-VolumesListAdminTestJSON-1282505341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.794s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-39a9664a-cbfa-48c2-a558-472392fa40a7 tempest-VolumesListAdminTestJSON-1282505341 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:21:28 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-39a9664a-cbfa-48c2-a558-472392fa40a7 tempest-VolumesListAdminTestJSON-1282505341 None] Deleted volume successfully. Apr 29 17:21:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-39a9664a-cbfa-48c2-a558-472392fa40a7 tempest-VolumesListAdminTestJSON-1282505341 None] Lock "cinder-6107b6d1-f671-442e-98f9-28474d929523-delete_volume" released by "delete_volume" :: held 9.006s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:21:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-1e8da1bf-54a9-4053-8067-334998ee8027 req-74c55350-091d-4ac1-b682-361f872badd5 tempest-AttachVolumeShelveTestJSON-737584018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:29 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00" returned: 0 in 0.869s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:29 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d8b2ae61-74bb-47fd-9523-17d18a84922b tempest-VolumesListAdminTestJSON-1282505341 None] Acquiring lock "cinder-d0179010-b930-469f-a894-1aee34f15444-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:21:29 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e 1G Apr 29 17:21:29 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:29 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d8b2ae61-74bb-47fd-9523-17d18a84922b tempest-VolumesListAdminTestJSON-1282505341 None] Lock "cinder-d0179010-b930-469f-a894-1aee34f15444-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:21:29 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d8b2ae61-74bb-47fd-9523-17d18a84922b tempest-VolumesListAdminTestJSON-1282505341 None] Acquiring lock "cinder-quobyte-d0179010-b930-469f-a894-1aee34f15444" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:21:29 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d8b2ae61-74bb-47fd-9523-17d18a84922b tempest-VolumesListAdminTestJSON-1282505341 None] Lock "cinder-quobyte-d0179010-b930-469f-a894-1aee34f15444" acquired by "delete_volume" :: waited 0.028s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:21:29 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[93050109-38f0-4d1c-8ec2-5b8d1e80a5a8]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:21:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d8b2ae61-74bb-47fd-9523-17d18a84922b tempest-VolumesListAdminTestJSON-1282505341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d0179010-b930-469f-a894-1aee34f15444 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:29 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d0179010-b930-469f-a894-1aee34f15444 Apr 29 17:21:29 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:29 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e 1G" returned: 0 in 0.838s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3caade-99f7-406a-a44e-a8850ca97a00 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:29 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3caade-99f7-406a-a44e-a8850ca97a00 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e Apr 29 17:21:29 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:29 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d8b2ae61-74bb-47fd-9523-17d18a84922b tempest-VolumesListAdminTestJSON-1282505341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d0179010-b930-469f-a894-1aee34f15444" returned: 0 in 0.738s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d8b2ae61-74bb-47fd-9523-17d18a84922b tempest-VolumesListAdminTestJSON-1282505341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d0179010-b930-469f-a894-1aee34f15444 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:29 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d0179010-b930-469f-a894-1aee34f15444 Apr 29 17:21:29 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:30 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3caade-99f7-406a-a44e-a8850ca97a00 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e" returned: 0 in 0.650s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:30 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e is being set with open permissions: ugo+rw: NotImplementedError Apr 29 17:21:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:30 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d8b2ae61-74bb-47fd-9523-17d18a84922b tempest-VolumesListAdminTestJSON-1282505341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d0179010-b930-469f-a894-1aee34f15444" returned: 0 in 0.621s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d8b2ae61-74bb-47fd-9523-17d18a84922b tempest-VolumesListAdminTestJSON-1282505341 None] Lock "cinder-quobyte-d0179010-b930-469f-a894-1aee34f15444" released by "delete_volume" :: held 1.401s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:21:30 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e Apr 29 17:21:30 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:30 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-d8b2ae61-74bb-47fd-9523-17d18a84922b tempest-VolumesListAdminTestJSON-1282505341 None] Created reservations ['1fcfee9c-c395-4bc3-89a3-3420e5001294', '8326e14f-75c7-48d2-90b7-08b67ae8b255', '420d6eba-f3fb-46ad-a428-d8983d974aed', '49c70f4e-14cb-4e12-9efc-bcfc2a049c70'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:21:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d8b2ae61-74bb-47fd-9523-17d18a84922b tempest-VolumesListAdminTestJSON-1282505341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d8b2ae61-74bb-47fd-9523-17d18a84922b tempest-VolumesListAdminTestJSON-1282505341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d8b2ae61-74bb-47fd-9523-17d18a84922b tempest-VolumesListAdminTestJSON-1282505341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:21:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d8b2ae61-74bb-47fd-9523-17d18a84922b tempest-VolumesListAdminTestJSON-1282505341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:21:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d8b2ae61-74bb-47fd-9523-17d18a84922b tempest-VolumesListAdminTestJSON-1282505341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d8b2ae61-74bb-47fd-9523-17d18a84922b tempest-VolumesListAdminTestJSON-1282505341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:30 devstack sudo[99389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:21:30 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:31 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e" returned: 0 in 0.643s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:31 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.info Apr 29 17:21:31 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:31 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d8b2ae61-74bb-47fd-9523-17d18a84922b tempest-VolumesListAdminTestJSON-1282505341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.621s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:31 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-d8b2ae61-74bb-47fd-9523-17d18a84922b tempest-VolumesListAdminTestJSON-1282505341 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:21:31 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d8b2ae61-74bb-47fd-9523-17d18a84922b tempest-VolumesListAdminTestJSON-1282505341 None] Deleted volume successfully. Apr 29 17:21:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d8b2ae61-74bb-47fd-9523-17d18a84922b tempest-VolumesListAdminTestJSON-1282505341 None] Lock "cinder-d0179010-b930-469f-a894-1aee34f15444-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:21:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-aad7bd0a-1ede-4d6b-b546-e06b551c368c tempest-VolumesListAdminTestJSON-1282505341 None] Acquiring lock "cinder-a667b02b-f1e1-4a3a-b8b0-febcb28098f2-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:21:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-aad7bd0a-1ede-4d6b-b546-e06b551c368c tempest-VolumesListAdminTestJSON-1282505341 None] Lock "cinder-a667b02b-f1e1-4a3a-b8b0-febcb28098f2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:21:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-aad7bd0a-1ede-4d6b-b546-e06b551c368c tempest-VolumesListAdminTestJSON-1282505341 None] Acquiring lock "cinder-quobyte-a667b02b-f1e1-4a3a-b8b0-febcb28098f2" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:21:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-aad7bd0a-1ede-4d6b-b546-e06b551c368c tempest-VolumesListAdminTestJSON-1282505341 None] Lock "cinder-quobyte-a667b02b-f1e1-4a3a-b8b0-febcb28098f2" acquired by "delete_volume" :: waited 0.015s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:21:31 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cadf65-b7c0-4edf-aa59-c19508d577b5]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:21:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-aad7bd0a-1ede-4d6b-b546-e06b551c368c tempest-VolumesListAdminTestJSON-1282505341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a667b02b-f1e1-4a3a-b8b0-febcb28098f2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:31 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a667b02b-f1e1-4a3a-b8b0-febcb28098f2 Apr 29 17:21:31 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:31 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.info" returned: 0 in 0.674s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:31 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 17:21:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:31 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.info Apr 29 17:21:31 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:32 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-aad7bd0a-1ede-4d6b-b546-e06b551c368c tempest-VolumesListAdminTestJSON-1282505341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a667b02b-f1e1-4a3a-b8b0-febcb28098f2" returned: 0 in 0.766s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-aad7bd0a-1ede-4d6b-b546-e06b551c368c tempest-VolumesListAdminTestJSON-1282505341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a667b02b-f1e1-4a3a-b8b0-febcb28098f2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:32 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a667b02b-f1e1-4a3a-b8b0-febcb28098f2 Apr 29 17:21:32 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:32 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.info" returned: 0 in 0.667s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.449s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-1e8da1bf-54a9-4053-8067-334998ee8027 req-74c55350-091d-4ac1-b682-361f872badd5 tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.608s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:32 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fad330d-474a-42e6-9b04-14fca1e748cc]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:21:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-1e8da1bf-54a9-4053-8067-334998ee8027 req-74c55350-091d-4ac1-b682-361f872badd5 tempest-AttachVolumeShelveTestJSON-737584018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:32 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-c5e138f5-0de9-45e7-b362-1150f4680557 tempest-GroupSnapshotsTest-1478505142 None] group_snapshot c58a7c8c-0097-4a55-821d-aa82597a1421: created successfully Apr 29 17:21:32 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d Apr 29 17:21:32 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:33 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-aad7bd0a-1ede-4d6b-b546-e06b551c368c tempest-VolumesListAdminTestJSON-1282505341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a667b02b-f1e1-4a3a-b8b0-febcb28098f2" returned: 0 in 0.676s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:33 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-aad7bd0a-1ede-4d6b-b546-e06b551c368c tempest-VolumesListAdminTestJSON-1282505341 None] Lock "cinder-quobyte-a667b02b-f1e1-4a3a-b8b0-febcb28098f2" released by "delete_volume" :: held 1.493s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:21:33 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-aad7bd0a-1ede-4d6b-b546-e06b551c368c tempest-VolumesListAdminTestJSON-1282505341 None] Created reservations ['445026d8-2788-4c78-a66a-8c0a8614440f', '92804524-8f72-47b8-b3d4-d5dd22618e39', '26609b85-60e2-4702-ba16-2db22e298c0e', '812221f2-bdc7-45c2-a0b8-9fdab4b24061'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:21:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-aad7bd0a-1ede-4d6b-b546-e06b551c368c tempest-VolumesListAdminTestJSON-1282505341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-aad7bd0a-1ede-4d6b-b546-e06b551c368c tempest-VolumesListAdminTestJSON-1282505341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-aad7bd0a-1ede-4d6b-b546-e06b551c368c tempest-VolumesListAdminTestJSON-1282505341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:21:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-aad7bd0a-1ede-4d6b-b546-e06b551c368c tempest-VolumesListAdminTestJSON-1282505341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:21:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-aad7bd0a-1ede-4d6b-b546-e06b551c368c tempest-VolumesListAdminTestJSON-1282505341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-aad7bd0a-1ede-4d6b-b546-e06b551c368c tempest-VolumesListAdminTestJSON-1282505341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:33 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:21:33 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:33 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-1e8da1bf-54a9-4053-8067-334998ee8027 req-74c55350-091d-4ac1-b682-361f872badd5 tempest-AttachVolumeShelveTestJSON-737584018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d" returned: 0 in 0.977s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-1e8da1bf-54a9-4053-8067-334998ee8027 req-74c55350-091d-4ac1-b682-361f872badd5 tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.012s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-1e8da1bf-54a9-4053-8067-334998ee8027 req-74c55350-091d-4ac1-b682-361f872badd5 tempest-AttachVolumeShelveTestJSON-737584018 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd168e7d0-35c1-42d2-95d8-696f73008a62', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:21:33 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-1e8da1bf-54a9-4053-8067-334998ee8027 req-74c55350-091d-4ac1-b682-361f872badd5 tempest-AttachVolumeShelveTestJSON-737584018 None] attachment_update completed successfully. Apr 29 17:21:34 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-aad7bd0a-1ede-4d6b-b546-e06b551c368c tempest-VolumesListAdminTestJSON-1282505341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.882s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-aad7bd0a-1ede-4d6b-b546-e06b551c368c tempest-VolumesListAdminTestJSON-1282505341 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:21:34 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-aad7bd0a-1ede-4d6b-b546-e06b551c368c tempest-VolumesListAdminTestJSON-1282505341 None] Deleted volume successfully. Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-aad7bd0a-1ede-4d6b-b546-e06b551c368c tempest-VolumesListAdminTestJSON-1282505341 None] Lock "cinder-a667b02b-f1e1-4a3a-b8b0-febcb28098f2-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "cinder-quobyte-aa53166e-723b-4dcb-9b77-5d54b1d44b3e-962bdca7-2651-4514-ab25-632573b2192c" by "_create_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-aa53166e-723b-4dcb-9b77-5d54b1d44b3e-962bdca7-2651-4514-ab25-632573b2192c" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Creating volume 962bdca7-2651-4514-ab25-632573b2192c from snapshot aa53166e-723b-4dcb-9b77-5d54b1d44b3e {{(pid=84547) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "cinder-quobyte-962bdca7-2651-4514-ab25-632573b2192c" by "_copy_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-962bdca7-2651-4514-ab25-632573b2192c" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] snapshot: aa53166e-723b-4dcb-9b77-5d54b1d44b3e, volume: 962bdca7-2651-4514-ab25-632573b2192c, {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ea4cfc-3148-4072-8583-858ecd540ce3]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:21:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:35 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e Apr 29 17:21:35 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:35 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e" returned: 0 in 0.881s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:35 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c3caade-99f7-406a-a44e-a8850ca97a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:21:35 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 17:21:35 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Creating direct copy from snapshot {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 17:21:35 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7b7817-8c72-47de-b10e-93769dcd89b3]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:21:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:36 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 Apr 29 17:21:36 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:36 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00" returned: 0 in 0.850s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:36 devstack cinder-volume[84547]: DEBUG cinder.utils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Path /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-962bdca7-2651-4514-ab25-632573b2192c not found in is_blk_device check {{(pid=84547) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 17:21:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-962bdca7-2651-4514-ab25-632573b2192c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:36 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-962bdca7-2651-4514-ab25-632573b2192c Apr 29 17:21:36 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:43 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:21:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Flow 'volume_create_manager' (f6394b62-b4e8-425f-ba7a-1c6762f21590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:21:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d4513c-fe7d-402a-be8e-c7874793747e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d4513c-fe7d-402a-be8e-c7874793747e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-778447035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7657714-80ca-4056-beb9-6d395264d4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb6c68e5f07404c82ff71211cd3429f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:21:43Z,use_quota=True,user_id='b9db9408f80a4f6eb98476e558824f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996e71fc-d242-4550-985c-6313e2ed5ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996e71fc-d242-4550-985c-6313e2ed5ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c236337-296f-40dc-a5ca-2497de8facc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:43 devstack cinder-volume[84547]: DEBUG cinder.image.glance [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Creating Keystone auth plugin from conf {{(pid=84547) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 17:21:44 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-962bdca7-2651-4514-ab25-632573b2192c" returned: 0 in 7.850s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:44 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[485a4c18-3a31-4451-bd22-e1f8269f3b7e]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:21:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c236337-296f-40dc-a5ca-2497de8facc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c7657714-80ca-4056-beb9-6d395264d4f8', 'volume_name': 'volume-c7657714-80ca-4056-beb9-6d395264d4f8', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (598b3793-5c03-45ba-84c5-7e34cd4f4ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (598b3793-5c03-45ba-84c5-7e34cd4f4ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a710af07-f616-413a-b734-d29581e67d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:44 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Volume c7657714-80ca-4056-beb9-6d395264d4f8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c7657714-80ca-4056-beb9-6d395264d4f8', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 17:21:44 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Trying to clone c7657714-80ca-4056-beb9-6d395264d4f8 from image 982d68c3-05b9-445d-85e5-5c92642a92aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]). {{(pid=84547) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 17:21:44 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 Apr 29 17:21:44 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:45 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_h481rdhldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 17:21:45 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Image download 20.69 MB at 20.69 MB/s Apr 29 17:21:45 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8c6afc-9e4e-41c6-a2ce-db5a3b12b3a3]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:21:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_h481rdhldevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:45 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_h481rdhldevstack@QuobyteHD Apr 29 17:21:45 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:45 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00" returned: 0 in 1.183s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:45 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00, size 1024.00 MB, duration 7.85 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-962bdca7-2651-4514-ab25-632573b2192c {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:21:45 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Converted 1024.00 MB image at 130.42 MB/s Apr 29 17:21:45 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-962bdca7-2651-4514-ab25-632573b2192c is being set with open permissions: ugo+rw: NotImplementedError Apr 29 17:21:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-962bdca7-2651-4514-ab25-632573b2192c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:45 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-962bdca7-2651-4514-ab25-632573b2192c Apr 29 17:21:45 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:46 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_h481rdhldevstack@QuobyteHD" returned: 0 in 0.934s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:46 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Temporary image 982d68c3-05b9-445d-85e5-5c92642a92aa is fetched for user b9db9408f80a4f6eb98476e558824f0b. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 17:21:46 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ada526-3c4e-42cd-b22f-f4b27b7c1fe5]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:21:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_h481rdhldevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:46 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_h481rdhldevstack@QuobyteHD Apr 29 17:21:46 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:46 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-962bdca7-2651-4514-ab25-632573b2192c" returned: 0 in 1.005s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-962bdca7-2651-4514-ab25-632573b2192c" released by "_copy_volume_from_snapshot" :: held 11.981s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:21:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-aa53166e-723b-4dcb-9b77-5d54b1d44b3e-962bdca7-2651-4514-ab25-632573b2192c" released by "_create_volume_from_snapshot" :: held 12.045s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:21:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.070s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:47 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-3ff1a4b3-75d4-4ec2-bb53-4986c96f650a tempest-GroupSnapshotsTest-1478505142 None] Create group from source-snapshot-c58a7c8c-0097-4a55-821d-aa82597a1421 completed successfully. Apr 29 17:21:47 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_h481rdhldevstack@QuobyteHD" returned: 0 in 1.221s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-778447035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7657714-80ca-4056-beb9-6d395264d4f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fb6c68e5f07404c82ff71211cd3429f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:21:43Z,use_quota=True,user_id='b9db9408f80a4f6eb98476e558824f0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:21:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Creating volume c7657714-80ca-4056-beb9-6d395264d4f8 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:21:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:21:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:21:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:21:47 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:21:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:47 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 1073741824 Apr 29 17:21:47 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:49 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e3ce3388-d964-477e-b327-c938b46feb5a tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "cinder-quobyte-962bdca7-2651-4514-ab25-632573b2192c" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:21:49 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e3ce3388-d964-477e-b327-c938b46feb5a tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-962bdca7-2651-4514-ab25-632573b2192c" acquired by "delete_volume" :: waited 0.025s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:21:49 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b87e221-5de2-450d-b2b2-288b490af3fd]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:21:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e3ce3388-d964-477e-b327-c938b46feb5a tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-962bdca7-2651-4514-ab25-632573b2192c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:49 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 1073741824" returned: 0 in 1.495s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:49 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-962bdca7-2651-4514-ab25-632573b2192c Apr 29 17:21:49 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:49 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 Apr 29 17:21:49 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:50 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8" returned: 0 in 0.750s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] <== create_volume: return (2376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:21:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.380s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:50 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Attempting download of 982d68c3-05b9-445d-85e5-5c92642a92aa ((None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}])) to volume c7657714-80ca-4056-beb9-6d395264d4f8. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 17:21:50 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e3ce3388-d964-477e-b327-c938b46feb5a tempest-GroupSnapshotsTest-1478505142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-962bdca7-2651-4514-ab25-632573b2192c" returned: 0 in 1.100s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e3ce3388-d964-477e-b327-c938b46feb5a tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-962bdca7-2651-4514-ab25-632573b2192c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:50 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[366f88e5-f604-4893-90cd-61547dc8ef93]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:21:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_xr5if_40 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:50 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-962bdca7-2651-4514-ab25-632573b2192c Apr 29 17:21:50 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:50 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_xr5if_40 Apr 29 17:21:50 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:51 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_xr5if_40" returned: 0 in 0.779s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_xr5if_40 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:51 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e3ce3388-d964-477e-b327-c938b46feb5a tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-962bdca7-2651-4514-ab25-632573b2192c" returned: 0 in 0.837s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e3ce3388-d964-477e-b327-c938b46feb5a tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-962bdca7-2651-4514-ab25-632573b2192c" released by "delete_volume" :: held 2.000s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:21:51 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=74,cinder:SELECT=60,cinder:INSERT=14,cinder:DELETE=4 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:21:51 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=87,cinder:DELETE=10,cinder:SELECT=73,cinder:INSERT=20 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:21:51 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_xr5if_40 Apr 29 17:21:51 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:51 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-e3ce3388-d964-477e-b327-c938b46feb5a tempest-GroupSnapshotsTest-1478505142 None] Created reservations ['e46da64f-c3b0-483e-b6e6-2e8125b5f8d3'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:21:51 devstack cinder-volume[84547]: WARNING cinder.quota [None req-e3ce3388-d964-477e-b327-c938b46feb5a tempest-GroupSnapshotsTest-1478505142 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1186656838 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1186656838, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:21:51 devstack cinder-volume[84547]: WARNING cinder.quota [None req-e3ce3388-d964-477e-b327-c938b46feb5a tempest-GroupSnapshotsTest-1478505142 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1186656838 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1186656838, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:21:51 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-e3ce3388-d964-477e-b327-c938b46feb5a tempest-GroupSnapshotsTest-1478505142 None] Created reservations ['6a32cc89-9956-4a88-a57c-ca9ab53a3b04', '2aed1884-e52a-48ca-aab7-8398562cd17e', 'a982b834-ec4b-4ecc-b670-5c1775cfdd3c', 'd343b695-0b43-4623-a86d-44a8b0679b66'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:21:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e3ce3388-d964-477e-b327-c938b46feb5a tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:21:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e3ce3388-d964-477e-b327-c938b46feb5a tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:21:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e3ce3388-d964-477e-b327-c938b46feb5a tempest-GroupSnapshotsTest-1478505142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:21:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e3ce3388-d964-477e-b327-c938b46feb5a tempest-GroupSnapshotsTest-1478505142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:21:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e3ce3388-d964-477e-b327-c938b46feb5a tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:21:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e3ce3388-d964-477e-b327-c938b46feb5a tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:51 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:21:51 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:52 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_xr5if_40" returned: 1 in 1.074s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_xr5if_40' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:21:52 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93a027e-af4a-4f57-a577-507eb4bf4f5f]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:21:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_h481rdhldevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:52 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_h481rdhldevstack@QuobyteHD Apr 29 17:21:52 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:52 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e3ce3388-d964-477e-b327-c938b46feb5a tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.044s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:52 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-e3ce3388-d964-477e-b327-c938b46feb5a tempest-GroupSnapshotsTest-1478505142 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:21:52 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e3ce3388-d964-477e-b327-c938b46feb5a tempest-GroupSnapshotsTest-1478505142 None] Delete group completed successfully. Apr 29 17:21:52 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] group_snapshot c58a7c8c-0097-4a55-821d-aa82597a1421: deleting Apr 29 17:21:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] group_snapshot c58a7c8c-0097-4a55-821d-aa82597a1421: deleting {{(pid=84547) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 17:21:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "cinder-quobyte-6c3caade-99f7-406a-a44e-a8850ca97a00" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:21:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-6c3caade-99f7-406a-a44e-a8850ca97a00" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:21:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "cinder-quobyte-aa53166e-723b-4dcb-9b77-5d54b1d44b3e" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:21:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-aa53166e-723b-4dcb-9b77-5d54b1d44b3e" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:21:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] Deleting offline snapshot aa53166e-723b-4dcb-9b77-5d54b1d44b3e of volume 6c3caade-99f7-406a-a44e-a8850ca97a00 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:21:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] snapshot_file for this snap is: volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:21:53 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77832f0-d8f7-41c1-a958-302ecefea3ea]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:21:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:53 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e Apr 29 17:21:53 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:53 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_h481rdhldevstack@QuobyteHD" returned: 0 in 1.425s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:53 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] 982d68c3-05b9-445d-85e5-5c92642a92aa was qcow2, converting to raw {{(pid=84547) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 17:21:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_h481rdhldevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:53 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_h481rdhldevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 Apr 29 17:21:53 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:54 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e" returned: 0 in 1.314s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c3caade-99f7-406a-a44e-a8850ca97a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:21:54 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[859a2f75-2965-4c44-8ad4-7167364528ce]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:21:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:54 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 Apr 29 17:21:54 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:55 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00" returned: 0 in 0.985s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:55 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e Apr 29 17:21:55 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:56 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e" returned: 0 in 0.836s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:56 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e Apr 29 17:21:56 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:56 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_h481rdhldevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8" returned: 0 in 2.622s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:56 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_h481rdhldevstack@QuobyteHD, size 112.00 MB, duration 2.62 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:21:56 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Converted 112.00 MB image at 42.69 MB/s Apr 29 17:21:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:56 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 1G Apr 29 17:21:56 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:56 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00.aa53166e-723b-4dcb-9b77-5d54b1d44b3e" returned: 0 in 0.622s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-aa53166e-723b-4dcb-9b77-5d54b1d44b3e" released by "_delete_snapshot" :: held 3.897s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:21:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-6c3caade-99f7-406a-a44e-a8850ca97a00" released by "delete_snapshot" :: held 3.945s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:21:56 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 1G" returned: 0 in 0.641s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:56 devstack cinder-volume[84547]: WARNING cinder.quota [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1186656838 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1186656838, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:21:56 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c46394-1e79-4b49-afc8-fae43ce5e167]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:21:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:56 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] Created reservations ['9084796e-80bd-4026-95b9-cb81856c1eb6', 'ccd9e54f-4101-4a9d-b35b-47af0387db80', '2304b3ce-a57a-4335-a0c8-a20d95ad955f', '00b47808-c8bc-41fb-a4c4-1c861791da94'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:21:57 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-9c7220cf-b932-4b5d-b98e-5b7db54d8565 tempest-GroupSnapshotsTest-1478505142 None] group_snapshot c58a7c8c-0097-4a55-821d-aa82597a1421: deleted successfully Apr 29 17:21:57 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 Apr 29 17:21:57 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:57 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8" returned: 0 in 0.787s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f71695a8-db50-4b8f-86c9-bb3b1a3a07a5 tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "cinder-quobyte-6c3caade-99f7-406a-a44e-a8850ca97a00" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:21:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f71695a8-db50-4b8f-86c9-bb3b1a3a07a5 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-6c3caade-99f7-406a-a44e-a8850ca97a00" acquired by "delete_volume" :: waited 0.026s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:21:57 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[769900cf-5789-47a0-8b11-3e8a2dd2b9df]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:21:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f71695a8-db50-4b8f-86c9-bb3b1a3a07a5 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:57 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 Apr 29 17:21:57 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:58 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 Apr 29 17:21:58 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:58 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8" returned: 1 in 1.079s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:21:58 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Downloaded image 982d68c3-05b9-445d-85e5-5c92642a92aa ((None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}])) to volume c7657714-80ca-4056-beb9-6d395264d4f8 successfully. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 17:21:58 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Temporary image 982d68c3-05b9-445d-85e5-5c92642a92aa for user b9db9408f80a4f6eb98476e558824f0b is deleted. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 17:21:58 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Marking volume c7657714-80ca-4056-beb9-6d395264d4f8 as bootable. {{(pid=84547) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 17:21:58 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Copying metadata from image 982d68c3-05b9-445d-85e5-5c92642a92aa to c7657714-80ca-4056-beb9-6d395264d4f8. {{(pid=84547) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 17:21:58 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Creating volume glance metadata for volume c7657714-80ca-4056-beb9-6d395264d4f8 backed by image 982d68c3-05b9-445d-85e5-5c92642a92aa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84547) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 17:21:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a710af07-f616-413a-b734-d29581e67d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7657714-80ca-4056-beb9-6d395264d4f8', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0405a1f5-f861-4769-bd58-e71649874866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:21:59 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Volume volume-c7657714-80ca-4056-beb9-6d395264d4f8 (c7657714-80ca-4056-beb9-6d395264d4f8): created successfully Apr 29 17:21:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0405a1f5-f861-4769-bd58-e71649874866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:21:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Flow 'volume_create_manager' (f6394b62-b4e8-425f-ba7a-1c6762f21590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:21:59 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-1bfdf0ea-47b5-400d-970a-283164650120 tempest-VolumesImageMetadata-1916989123 None] Created volume successfully. Apr 29 17:21:59 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f71695a8-db50-4b8f-86c9-bb3b1a3a07a5 tempest-GroupSnapshotsTest-1478505142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00" returned: 0 in 1.413s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f71695a8-db50-4b8f-86c9-bb3b1a3a07a5 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:21:59 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00 Apr 29 17:21:59 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:21:59 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Apr 29 17:21:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f71695a8-db50-4b8f-86c9-bb3b1a3a07a5 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-6c3caade-99f7-406a-a44e-a8850ca97a00" returned: 0 in 0.641s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:21:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f71695a8-db50-4b8f-86c9-bb3b1a3a07a5 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-6c3caade-99f7-406a-a44e-a8850ca97a00" released by "delete_volume" :: held 2.158s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:22:00 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-f71695a8-db50-4b8f-86c9-bb3b1a3a07a5 tempest-GroupSnapshotsTest-1478505142 None] Created reservations ['3c762fae-71c2-461f-ac4f-f332c038b43e'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:22:00 devstack cinder-volume[84547]: WARNING cinder.db.sqlalchemy.api [None req-f71695a8-db50-4b8f-86c9-bb3b1a3a07a5 tempest-GroupSnapshotsTest-1478505142 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1186656838'] Apr 29 17:22:00 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-f71695a8-db50-4b8f-86c9-bb3b1a3a07a5 tempest-GroupSnapshotsTest-1478505142 None] Created reservations ['e38cb29c-3bf7-400f-97fd-955907d49f03', '1273adce-8abe-462a-a95f-3e990b83b0d8', '7918918d-653b-426f-bdca-7ac90ac1086c', '0b113bf6-f7b4-4ee8-9f1a-8ceb7c48bf3e'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:22:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f71695a8-db50-4b8f-86c9-bb3b1a3a07a5 tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f71695a8-db50-4b8f-86c9-bb3b1a3a07a5 tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f71695a8-db50-4b8f-86c9-bb3b1a3a07a5 tempest-GroupSnapshotsTest-1478505142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:22:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f71695a8-db50-4b8f-86c9-bb3b1a3a07a5 tempest-GroupSnapshotsTest-1478505142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:22:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f71695a8-db50-4b8f-86c9-bb3b1a3a07a5 tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f71695a8-db50-4b8f-86c9-bb3b1a3a07a5 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:00 devstack sudo[100184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:22:00 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] Acquiring lock "cinder-c7657714-80ca-4056-beb9-6d395264d4f8-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:22:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] Lock "cinder-c7657714-80ca-4056-beb9-6d395264d4f8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:22:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] Acquiring lock "cinder-quobyte-c7657714-80ca-4056-beb9-6d395264d4f8" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:22:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] Lock "cinder-quobyte-c7657714-80ca-4056-beb9-6d395264d4f8" acquired by "delete_volume" :: waited 0.021s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:22:00 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cc95f7-3948-48f7-9d98-8afb6654ae8c]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:00 devstack sudo[100187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 Apr 29 17:22:00 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:01 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f71695a8-db50-4b8f-86c9-bb3b1a3a07a5 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.834s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:01 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-f71695a8-db50-4b8f-86c9-bb3b1a3a07a5 tempest-GroupSnapshotsTest-1478505142 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:22:01 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f71695a8-db50-4b8f-86c9-bb3b1a3a07a5 tempest-GroupSnapshotsTest-1478505142 None] Delete group completed successfully. Apr 29 17:22:01 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8" returned: 0 in 0.778s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:01 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 Apr 29 17:22:01 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:01 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-5f3ab90d-5d51-495c-9ca5-67bc9c03739e tempest-GroupSnapshotsTest-1478505142 None] Group tempest-GroupSnapshotsTest-Group-1018785521: creating Apr 29 17:22:01 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-5f3ab90d-5d51-495c-9ca5-67bc9c03739e tempest-GroupSnapshotsTest-1478505142 None] Group tempest-GroupSnapshotsTest-Group-1018785521: created successfully Apr 29 17:22:01 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-5f3ab90d-5d51-495c-9ca5-67bc9c03739e tempest-GroupSnapshotsTest-1478505142 None] Create group completed successfully. Apr 29 17:22:02 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8" returned: 1 in 0.776s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:22:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:02 devstack sudo[100198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8 Apr 29 17:22:02 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:03 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7657714-80ca-4056-beb9-6d395264d4f8" returned: 0 in 0.665s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] Lock "cinder-quobyte-c7657714-80ca-4056-beb9-6d395264d4f8" released by "delete_volume" :: held 2.295s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] Created reservations ['3e589523-8685-4db7-9855-dcee6b1a66a7', '4cdf7dd7-5aee-496c-822b-eb7d866bc239', '598ebeb2-bb19-44de-a3f3-2d50a07f6c33', '5767c0cd-ff6d-4ddb-8b13-4d76d51143b2'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:03 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:22:03 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Flow 'volume_create_manager' (067f6510-06f0-4286-b699-7c02c54ede88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ec3e41-24a1-4d62-8067-e792ffb52f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ec3e41-24a1-4d62-8067-e792ffb52f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1140325027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8bf36666-8bcc-4274-a0f1-0e7c55544066,host='devstack@QuobyteHD#QuobyteHD',id=ac1ce6ab-8334-42d3-9429-542af6c64d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f11acad828d4ee2aa016f60ecda733d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:22:04Z,use_quota=True,user_id='5f9a5af157254c67ab571291e3ba3fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4147eec-3d7c-486e-8e01-e314050ba03e),volume_type_id=f4147eec-3d7c-486e-8e01-e314050ba03e)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b18bd6-5f25-4014-a3e3-102189999bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b18bd6-5f25-4014-a3e3-102189999bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9074b0-6132-4d3c-bb52-6e591a3d0bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c9074b0-6132-4d3c-bb52-6e591a3d0bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac1ce6ab-8334-42d3-9429-542af6c64d0d', 'volume_name': 'volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f65caf-034e-496b-9201-b909f2c7b95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f65caf-034e-496b-9201-b909f2c7b95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6ef3d6-5bc2-4953-864c-0e6e3734827f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:03 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Volume ac1ce6ab-8334-42d3-9429-542af6c64d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d', 'volume_size': 1} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8bf36666-8bcc-4274-a0f1-0e7c55544066,created_at=2026-04-29T15:22:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1140325027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8bf36666-8bcc-4274-a0f1-0e7c55544066,host='devstack@QuobyteHD#QuobyteHD',id=ac1ce6ab-8334-42d3-9429-542af6c64d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f11acad828d4ee2aa016f60ecda733d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:22:04Z,use_quota=True,user_id='5f9a5af157254c67ab571291e3ba3fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4147eec-3d7c-486e-8e01-e314050ba03e),volume_type_id=f4147eec-3d7c-486e-8e01-e314050ba03e)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Creating volume ac1ce6ab-8334-42d3-9429-542af6c64d0d {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:22:03 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:22:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:03 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d 1073741824 Apr 29 17:22:03 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:04 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.917s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:04 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:22:04 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] Deleted volume successfully. Apr 29 17:22:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5a5161a3-c3dc-4d5e-9c6b-65298ff15de1 tempest-VolumesImageMetadata-1916989123 None] Lock "cinder-c7657714-80ca-4056-beb9-6d395264d4f8-delete_volume" released by "delete_volume" :: held 3.576s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:22:04 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d 1073741824" returned: 0 in 1.025s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:04 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d Apr 29 17:22:04 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:22:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:22:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:22:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:05 devstack sudo[100212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:22:05 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:05 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d" returned: 0 in 0.886s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:22:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.081s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:05 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6ef3d6-5bc2-4953-864c-0e6e3734827f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:05 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4382410b-d511-4c46-b2fd-8f10844dd5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:05 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Volume volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d (ac1ce6ab-8334-42d3-9429-542af6c64d0d): created successfully Apr 29 17:22:05 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4382410b-d511-4c46-b2fd-8f10844dd5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Flow 'volume_create_manager' (067f6510-06f0-4286-b699-7c02c54ede88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:22:06 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-70935958-eea0-4f1c-a0ba-d2b1791fbed5 tempest-GroupSnapshotsTest-1478505142 None] Created volume successfully. Apr 29 17:22:06 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.952s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Flow 'volume_create_manager' (5425b692-9f2a-410d-9e80-5a29953c9d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (781639fe-92e8-41ad-adde-5b9c68c99320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (781639fe-92e8-41ad-adde-5b9c68c99320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-151075910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8bf36666-8bcc-4274-a0f1-0e7c55544066,host='devstack@QuobyteHD#QuobyteHD',id=3727e521-c284-4b68-a3c6-3aa4b97a7653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f11acad828d4ee2aa016f60ecda733d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:22:08Z,use_quota=True,user_id='5f9a5af157254c67ab571291e3ba3fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4147eec-3d7c-486e-8e01-e314050ba03e),volume_type_id=f4147eec-3d7c-486e-8e01-e314050ba03e)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a6acaf5-11b9-43eb-8f9f-614a0b12f604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a6acaf5-11b9-43eb-8f9f-614a0b12f604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac17372-0f0c-4c43-852d-b54099311f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac17372-0f0c-4c43-852d-b54099311f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3727e521-c284-4b68-a3c6-3aa4b97a7653', 'volume_name': 'volume-3727e521-c284-4b68-a3c6-3aa4b97a7653', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16a3f3d-2c70-4bb1-a5a4-85841b09554c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16a3f3d-2c70-4bb1-a5a4-85841b09554c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757f81ed-5532-44c1-a49d-9efe7e52b084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:07 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Volume 3727e521-c284-4b68-a3c6-3aa4b97a7653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3727e521-c284-4b68-a3c6-3aa4b97a7653', 'volume_size': 1} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8bf36666-8bcc-4274-a0f1-0e7c55544066,created_at=2026-04-29T15:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-151075910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8bf36666-8bcc-4274-a0f1-0e7c55544066,host='devstack@QuobyteHD#QuobyteHD',id=3727e521-c284-4b68-a3c6-3aa4b97a7653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f11acad828d4ee2aa016f60ecda733d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:22:08Z,use_quota=True,user_id='5f9a5af157254c67ab571291e3ba3fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4147eec-3d7c-486e-8e01-e314050ba03e),volume_type_id=f4147eec-3d7c-486e-8e01-e314050ba03e)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Creating volume 3727e521-c284-4b68-a3c6-3aa4b97a7653 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:22:07 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:22:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:07 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653 1073741824 Apr 29 17:22:07 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:08 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:22:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Flow 'volume_create_manager' (7d5894cb-b9c0-47e5-bee7-59243f98766c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:22:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9efcb70-2e67-472a-b447-18628c3aa770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9efcb70-2e67-472a-b447-18628c3aa770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-420227433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd845c69-296a-4954-87da-24bc1e78902b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0314d72a936047488a7b10ff5b380460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:22:09Z,use_quota=True,user_id='661d1607acd641a9b798ed7f85a18557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6143b44d-fc7c-45f4-8c5d-1412f43d518b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6143b44d-fc7c-45f4-8c5d-1412f43d518b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5936d6c-ab8b-4c9b-be0b-f1a36abd9947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5936d6c-ab8b-4c9b-be0b-f1a36abd9947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd845c69-296a-4954-87da-24bc1e78902b', 'volume_name': 'volume-dd845c69-296a-4954-87da-24bc1e78902b', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10511b88-b4e4-4cf3-a6e6-270d0fed26a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10511b88-b4e4-4cf3-a6e6-270d0fed26a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:08 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109066fa-76d9-4b53-81ca-03d3232f0e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:08 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Volume dd845c69-296a-4954-87da-24bc1e78902b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd845c69-296a-4954-87da-24bc1e78902b', 'volume_size': 1} Apr 29 17:22:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653 1073741824" returned: 0 in 1.076s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:09 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653 Apr 29 17:22:09 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Flow 'volume_create_manager' (5cae0bea-2390-479d-8a30-b037420230d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9e7d39-fc25-41f5-a1ed-93b69871ded4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9e7d39-fc25-41f5-a1ed-93b69871ded4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1286416189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de5a9f45-6a69-4232-a7af-4c4321ed1cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757697e5832e410d946bafe668e93ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:22:09Z,use_quota=True,user_id='0ef4ba5e767a4b26b6279e5836013882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d90526-7c64-4832-9ef9-35206d3cb8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d90526-7c64-4832-9ef9-35206d3cb8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98aab296-4464-4f5b-b24e-190fd25dc537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98aab296-4464-4f5b-b24e-190fd25dc537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de5a9f45-6a69-4232-a7af-4c4321ed1cbb', 'volume_name': 'volume-de5a9f45-6a69-4232-a7af-4c4321ed1cbb', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c600eed-f998-4ee4-86bb-a5b15eb9fdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c600eed-f998-4ee4-86bb-a5b15eb9fdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc5b83f-7f51-4994-895c-b3eff66e7d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:09 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Volume de5a9f45-6a69-4232-a7af-4c4321ed1cbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de5a9f45-6a69-4232-a7af-4c4321ed1cbb', 'volume_size': 1} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:09 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653" returned: 0 in 0.609s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.644s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-420227433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd845c69-296a-4954-87da-24bc1e78902b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0314d72a936047488a7b10ff5b380460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:22:09Z,use_quota=True,user_id='661d1607acd641a9b798ed7f85a18557',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Creating volume dd845c69-296a-4954-87da-24bc1e78902b {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:22:09 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-dd845c69-296a-4954-87da-24bc1e78902b 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:09 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-dd845c69-296a-4954-87da-24bc1e78902b 1073741824 Apr 29 17:22:09 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757f81ed-5532-44c1-a49d-9efe7e52b084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3727e521-c284-4b68-a3c6-3aa4b97a7653', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (457eee65-17cf-4399-b9d7-c0d1c5735b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:09 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Volume volume-3727e521-c284-4b68-a3c6-3aa4b97a7653 (3727e521-c284-4b68-a3c6-3aa4b97a7653): created successfully Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (457eee65-17cf-4399-b9d7-c0d1c5735b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Flow 'volume_create_manager' (5425b692-9f2a-410d-9e80-5a29953c9d53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:22:09 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-67b7b39f-62e5-496c-acec-e24a91dc2b6c tempest-GroupSnapshotsTest-1478505142 None] Created volume successfully. Apr 29 17:22:10 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-b9bffef4-7892-43c0-ab3c-3b368cd0a8c2 tempest-GroupSnapshotsTest-1478505142 None] Update group completed successfully. Apr 29 17:22:10 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-dd845c69-296a-4954-87da-24bc1e78902b 1073741824" returned: 0 in 0.804s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-dd845c69-296a-4954-87da-24bc1e78902b {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:10 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-dd845c69-296a-4954-87da-24bc1e78902b Apr 29 17:22:10 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:11 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-dd845c69-296a-4954-87da-24bc1e78902b" returned: 0 in 0.603s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:22:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.713s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1286416189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de5a9f45-6a69-4232-a7af-4c4321ed1cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757697e5832e410d946bafe668e93ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:22:09Z,use_quota=True,user_id='0ef4ba5e767a4b26b6279e5836013882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:22:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Creating volume de5a9f45-6a69-4232-a7af-4c4321ed1cbb {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:22:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:22:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:22:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:22:11 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:22:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de5a9f45-6a69-4232-a7af-4c4321ed1cbb 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:11 devstack sudo[100241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de5a9f45-6a69-4232-a7af-4c4321ed1cbb 1073741824 Apr 29 17:22:11 devstack sudo[100241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109066fa-76d9-4b53-81ca-03d3232f0e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd845c69-296a-4954-87da-24bc1e78902b', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e64746-ee2a-45d0-ba87-c7c0b4c12ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:11 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Volume volume-dd845c69-296a-4954-87da-24bc1e78902b (dd845c69-296a-4954-87da-24bc1e78902b): created successfully Apr 29 17:22:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e64746-ee2a-45d0-ba87-c7c0b4c12ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Flow 'volume_create_manager' (7d5894cb-b9c0-47e5-bee7-59243f98766c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:22:11 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-eb5a561b-b2c6-49bf-a516-86e65d3be5a8 tempest-AbsoluteLimitsTests-1063555561 None] Created volume successfully. Apr 29 17:22:11 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-016bfe98-bc58-4444-a796-67559b7b47d4 tempest-GroupSnapshotsTest-1478505142 None] Update group completed successfully. Apr 29 17:22:11 devstack sudo[100241]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de5a9f45-6a69-4232-a7af-4c4321ed1cbb 1073741824" returned: 0 in 0.853s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de5a9f45-6a69-4232-a7af-4c4321ed1cbb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:11 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de5a9f45-6a69-4232-a7af-4c4321ed1cbb Apr 29 17:22:11 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:12 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-86faff08-a95f-43af-beb1-d2d66630b81a tempest-AbsoluteLimitsTests-1063555561 None] Acquiring lock "cinder-dd845c69-296a-4954-87da-24bc1e78902b-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:22:12 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-86faff08-a95f-43af-beb1-d2d66630b81a tempest-AbsoluteLimitsTests-1063555561 None] Lock "cinder-dd845c69-296a-4954-87da-24bc1e78902b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:22:12 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-86faff08-a95f-43af-beb1-d2d66630b81a tempest-AbsoluteLimitsTests-1063555561 None] Acquiring lock "cinder-quobyte-dd845c69-296a-4954-87da-24bc1e78902b" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:22:12 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-86faff08-a95f-43af-beb1-d2d66630b81a tempest-AbsoluteLimitsTests-1063555561 None] Lock "cinder-quobyte-dd845c69-296a-4954-87da-24bc1e78902b" acquired by "delete_volume" :: waited 0.021s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:22:12 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ef2516-5584-46c8-8c22-e60aa0cda376]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-86faff08-a95f-43af-beb1-d2d66630b81a tempest-AbsoluteLimitsTests-1063555561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-dd845c69-296a-4954-87da-24bc1e78902b {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:12 devstack sudo[100257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-dd845c69-296a-4954-87da-24bc1e78902b Apr 29 17:22:12 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:12 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-3a03833b-c143-4ff0-993c-68dbfafc6d9d tempest-GroupSnapshotsTest-1478505142 None] Update group completed successfully. Apr 29 17:22:12 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de5a9f45-6a69-4232-a7af-4c4321ed1cbb" returned: 0 in 0.705s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:22:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc5b83f-7f51-4994-895c-b3eff66e7d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de5a9f45-6a69-4232-a7af-4c4321ed1cbb', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7df5097-2283-49f7-bf76-d27061426c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:12 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Volume volume-de5a9f45-6a69-4232-a7af-4c4321ed1cbb (de5a9f45-6a69-4232-a7af-4c4321ed1cbb): created successfully Apr 29 17:22:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7df5097-2283-49f7-bf76-d27061426c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Flow 'volume_create_manager' (5cae0bea-2390-479d-8a30-b037420230d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:22:12 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-11a17952-6924-4857-8a1f-8be57f758927 tempest-AttachVolumeTestJSON-602814825 None] Created volume successfully. Apr 29 17:22:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-86faff08-a95f-43af-beb1-d2d66630b81a tempest-AbsoluteLimitsTests-1063555561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-dd845c69-296a-4954-87da-24bc1e78902b" returned: 0 in 0.817s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-86faff08-a95f-43af-beb1-d2d66630b81a tempest-AbsoluteLimitsTests-1063555561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-dd845c69-296a-4954-87da-24bc1e78902b {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:13 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:13 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-dd845c69-296a-4954-87da-24bc1e78902b Apr 29 17:22:13 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:13 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-86faff08-a95f-43af-beb1-d2d66630b81a tempest-AbsoluteLimitsTests-1063555561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-dd845c69-296a-4954-87da-24bc1e78902b" returned: 0 in 0.616s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:13 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-86faff08-a95f-43af-beb1-d2d66630b81a tempest-AbsoluteLimitsTests-1063555561 None] Lock "cinder-quobyte-dd845c69-296a-4954-87da-24bc1e78902b" released by "delete_volume" :: held 1.482s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:22:13 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ce530c64-be9b-4bc4-93c8-88a83183a2bb tempest-GroupSnapshotsTest-1478505142 None] Update group completed successfully. Apr 29 17:22:13 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-86faff08-a95f-43af-beb1-d2d66630b81a tempest-AbsoluteLimitsTests-1063555561 None] Created reservations ['811d0077-85b0-419b-ac84-451c9e5252d2', '44141190-063d-4c90-a2df-08b3a1d421b1', '784f1f96-4afc-463d-bd2e-07dcd37718d0', '1261831d-f663-42e6-9524-0e4859f93604'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:22:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-86faff08-a95f-43af-beb1-d2d66630b81a tempest-AbsoluteLimitsTests-1063555561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-86faff08-a95f-43af-beb1-d2d66630b81a tempest-AbsoluteLimitsTests-1063555561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-86faff08-a95f-43af-beb1-d2d66630b81a tempest-AbsoluteLimitsTests-1063555561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:22:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-86faff08-a95f-43af-beb1-d2d66630b81a tempest-AbsoluteLimitsTests-1063555561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:22:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-86faff08-a95f-43af-beb1-d2d66630b81a tempest-AbsoluteLimitsTests-1063555561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-86faff08-a95f-43af-beb1-d2d66630b81a tempest-AbsoluteLimitsTests-1063555561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:13 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:22:13 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:14 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-86faff08-a95f-43af-beb1-d2d66630b81a tempest-AbsoluteLimitsTests-1063555561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.588s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:14 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-86faff08-a95f-43af-beb1-d2d66630b81a tempest-AbsoluteLimitsTests-1063555561 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:22:14 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-86faff08-a95f-43af-beb1-d2d66630b81a tempest-AbsoluteLimitsTests-1063555561 None] Deleted volume successfully. Apr 29 17:22:14 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-86faff08-a95f-43af-beb1-d2d66630b81a tempest-AbsoluteLimitsTests-1063555561 None] Lock "cinder-dd845c69-296a-4954-87da-24bc1e78902b-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:22:15 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] GroupSnapshot 4acda4a4-6bd4-4165-a4a8-62334d4072b1: creating. Apr 29 17:22:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Group snapshot 4acda4a4-6bd4-4165-a4a8-62334d4072b1: creating. {{(pid=84547) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 17:22:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Creating offline snapshot 546d2007-3af7-4858-8388-3653f334a2ee of volume 3727e521-c284-4b68-a3c6-3aa4b97a7653 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:22:15 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3e1952-d173-4906-a223-a008dcacec75]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:15 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653 Apr 29 17:22:15 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:16 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653" returned: 0 in 0.816s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.546d2007-3af7-4858-8388-3653f334a2ee 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:16 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.546d2007-3af7-4858-8388-3653f334a2ee 1G Apr 29 17:22:16 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-326f4574-450b-437c-8332-4116db7e486e req-c754a84d-f53c-473c-8d31-b07dfa570869 tempest-AttachVolumeTestJSON-602814825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:16 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.546d2007-3af7-4858-8388-3653f334a2ee 1G" returned: 0 in 0.854s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3727e521-c284-4b68-a3c6-3aa4b97a7653 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.546d2007-3af7-4858-8388-3653f334a2ee {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:16 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3727e521-c284-4b68-a3c6-3aa4b97a7653 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.546d2007-3af7-4858-8388-3653f334a2ee Apr 29 17:22:16 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:17 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3727e521-c284-4b68-a3c6-3aa4b97a7653 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.546d2007-3af7-4858-8388-3653f334a2ee" returned: 0 in 0.690s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:17 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.546d2007-3af7-4858-8388-3653f334a2ee is being set with open permissions: ugo+rw: NotImplementedError Apr 29 17:22:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.546d2007-3af7-4858-8388-3653f334a2ee {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:17 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.546d2007-3af7-4858-8388-3653f334a2ee Apr 29 17:22:17 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:18 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.546d2007-3af7-4858-8388-3653f334a2ee" returned: 0 in 0.625s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:18 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.info Apr 29 17:22:18 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:18 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.info" returned: 0 in 0.693s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:18 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 17:22:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:18 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.info Apr 29 17:22:18 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:19 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.info" returned: 0 in 0.670s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.444s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Creating offline snapshot 5eef3ef0-f7c8-4cd2-b1bd-704be304f085 of volume ac1ce6ab-8334-42d3-9429-542af6c64d0d {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:22:19 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de8e8ae-5ca4-4f8b-ae1e-ee7f4b069c1b]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:19 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d Apr 29 17:22:19 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:20 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:22:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Flow 'volume_create_manager' (84371d42-0ad9-42a2-a0d4-2009ab5ae13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:22:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c434107a-cef6-4d8f-a76a-974e9580258c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c434107a-cef6-4d8f-a76a-974e9580258c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-551684775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b584e8-cef9-4cfc-9d62-9d8f3009dcde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e4162c946a42c0968fe6315122c35f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:22:20Z,use_quota=True,user_id='f11bdb038c304b4abd4201b2ebada510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37e689c-9db8-4ba7-8b91-1e3b85b0a1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e37e689c-9db8-4ba7-8b91-1e3b85b0a1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22be9a6d-498d-456d-bf5a-1e7fab8a78db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22be9a6d-498d-456d-bf5a-1e7fab8a78db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40b584e8-cef9-4cfc-9d62-9d8f3009dcde', 'volume_name': 'volume-40b584e8-cef9-4cfc-9d62-9d8f3009dcde', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b70430-2af6-4016-8b4a-60efd7f38392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b70430-2af6-4016-8b4a-60efd7f38392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d214c0f-55c8-4d33-99d2-4068c1fdf977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:20 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Volume 40b584e8-cef9-4cfc-9d62-9d8f3009dcde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40b584e8-cef9-4cfc-9d62-9d8f3009dcde', 'volume_size': 1} Apr 29 17:22:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:20 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d" returned: 0 in 0.777s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.5eef3ef0-f7c8-4cd2-b1bd-704be304f085 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:20 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.5eef3ef0-f7c8-4cd2-b1bd-704be304f085 1G Apr 29 17:22:20 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:21 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.5eef3ef0-f7c8-4cd2-b1bd-704be304f085 1G" returned: 0 in 0.778s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.5eef3ef0-f7c8-4cd2-b1bd-704be304f085 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:21 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.5eef3ef0-f7c8-4cd2-b1bd-704be304f085 Apr 29 17:22:21 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:21 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.5eef3ef0-f7c8-4cd2-b1bd-704be304f085" returned: 0 in 0.681s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:21 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.5eef3ef0-f7c8-4cd2-b1bd-704be304f085 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 17:22:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.5eef3ef0-f7c8-4cd2-b1bd-704be304f085 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:21 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.5eef3ef0-f7c8-4cd2-b1bd-704be304f085 Apr 29 17:22:21 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:21 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-e2952277-a299-420a-8efa-358c2e9bb16e req-4c91d14d-e26e-41a2-b9ff-df691c566f41 tempest-AttachVolumeShelveTestJSON-737584018 None] Terminate volume connection completed successfully. Apr 29 17:22:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-e2952277-a299-420a-8efa-358c2e9bb16e req-4c91d14d-e26e-41a2-b9ff-df691c566f41 tempest-AttachVolumeShelveTestJSON-737584018 None] Deleting attachment d168e7d0-35c1-42d2-95d8-696f73008a62. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:22:22 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.5eef3ef0-f7c8-4cd2-b1bd-704be304f085" returned: 0 in 0.606s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:22 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.info Apr 29 17:22:22 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:23 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.info" returned: 0 in 0.602s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:23 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 17:22:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:23 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.info Apr 29 17:22:23 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:23 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.info" returned: 0 in 0.585s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.115s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-326f4574-450b-437c-8332-4116db7e486e req-c754a84d-f53c-473c-8d31-b07dfa570869 tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.185s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:23 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e52183-8747-47ed-921e-1d9ba7a75625]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-326f4574-450b-437c-8332-4116db7e486e req-c754a84d-f53c-473c-8d31-b07dfa570869 tempest-AttachVolumeTestJSON-602814825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de5a9f45-6a69-4232-a7af-4c4321ed1cbb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:23 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de5a9f45-6a69-4232-a7af-4c4321ed1cbb Apr 29 17:22:23 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:23 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e31bb341-c0d5-474c-bc3b-d3b4c5ed720d tempest-GroupSnapshotsTest-1478505142 None] group_snapshot 4acda4a4-6bd4-4165-a4a8-62334d4072b1: created successfully Apr 29 17:22:24 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-326f4574-450b-437c-8332-4116db7e486e req-c754a84d-f53c-473c-8d31-b07dfa570869 tempest-AttachVolumeTestJSON-602814825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de5a9f45-6a69-4232-a7af-4c4321ed1cbb" returned: 0 in 0.752s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-326f4574-450b-437c-8332-4116db7e486e req-c754a84d-f53c-473c-8d31-b07dfa570869 tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.773s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.243s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-551684775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40b584e8-cef9-4cfc-9d62-9d8f3009dcde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e4162c946a42c0968fe6315122c35f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:22:20Z,use_quota=True,user_id='f11bdb038c304b4abd4201b2ebada510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:22:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Creating volume 40b584e8-cef9-4cfc-9d62-9d8f3009dcde {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:22:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:22:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:22:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:22:24 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:22:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-40b584e8-cef9-4cfc-9d62-9d8f3009dcde 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:24 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-40b584e8-cef9-4cfc-9d62-9d8f3009dcde 1073741824 Apr 29 17:22:24 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-326f4574-450b-437c-8332-4116db7e486e req-c754a84d-f53c-473c-8d31-b07dfa570869 tempest-AttachVolumeTestJSON-602814825 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-de5a9f45-6a69-4232-a7af-4c4321ed1cbb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10802f2a-ca6f-4859-857e-6a77624fe758', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:22:24 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-326f4574-450b-437c-8332-4116db7e486e req-c754a84d-f53c-473c-8d31-b07dfa570869 tempest-AttachVolumeTestJSON-602814825 None] attachment_update completed successfully. Apr 29 17:22:24 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] group_snapshot 4acda4a4-6bd4-4165-a4a8-62334d4072b1: deleting Apr 29 17:22:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] group_snapshot 4acda4a4-6bd4-4165-a4a8-62334d4072b1: deleting {{(pid=84547) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 17:22:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "cinder-quobyte-3727e521-c284-4b68-a3c6-3aa4b97a7653" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:22:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-3727e521-c284-4b68-a3c6-3aa4b97a7653" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:22:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "cinder-quobyte-546d2007-3af7-4858-8388-3653f334a2ee" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:22:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-546d2007-3af7-4858-8388-3653f334a2ee" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:22:25 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Deleting offline snapshot 546d2007-3af7-4858-8388-3653f334a2ee of volume 3727e521-c284-4b68-a3c6-3aa4b97a7653 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:22:25 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] snapshot_file for this snap is: volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.546d2007-3af7-4858-8388-3653f334a2ee {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:22:25 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7a52a0-32b8-4287-8225-0b02db87cce5]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.546d2007-3af7-4858-8388-3653f334a2ee {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:25 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.546d2007-3af7-4858-8388-3653f334a2ee Apr 29 17:22:25 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:25 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-40b584e8-cef9-4cfc-9d62-9d8f3009dcde 1073741824" returned: 0 in 1.128s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-40b584e8-cef9-4cfc-9d62-9d8f3009dcde {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:25 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-40b584e8-cef9-4cfc-9d62-9d8f3009dcde Apr 29 17:22:25 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:26 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.546d2007-3af7-4858-8388-3653f334a2ee" returned: 0 in 1.115s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3727e521-c284-4b68-a3c6-3aa4b97a7653(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:22:26 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f36e068-2fd7-40de-9e9d-e04f644619c6]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:26 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653 Apr 29 17:22:26 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:26 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-40b584e8-cef9-4cfc-9d62-9d8f3009dcde" returned: 0 in 0.730s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:22:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d214c0f-55c8-4d33-99d2-4068c1fdf977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40b584e8-cef9-4cfc-9d62-9d8f3009dcde', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae86071-f33b-414b-85c8-1ae13bbebd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:26 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Volume volume-40b584e8-cef9-4cfc-9d62-9d8f3009dcde (40b584e8-cef9-4cfc-9d62-9d8f3009dcde): created successfully Apr 29 17:22:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eae86071-f33b-414b-85c8-1ae13bbebd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Flow 'volume_create_manager' (84371d42-0ad9-42a2-a0d4-2009ab5ae13f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:22:26 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-1b2fb8a3-c1f1-4a81-b474-58821cb03f10 tempest-VolumesTransfersV357Test-1695003754 None] Created volume successfully. Apr 29 17:22:27 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653" returned: 0 in 0.792s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.546d2007-3af7-4858-8388-3653f334a2ee {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:27 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.546d2007-3af7-4858-8388-3653f334a2ee Apr 29 17:22:27 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:27 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4a233ff6-e973-4945-a9bc-f5f42bd5038d tempest-VolumesTransfersV357Test-1834725054 None] Transfer volume completed successfully. Apr 29 17:22:27 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.546d2007-3af7-4858-8388-3653f334a2ee" returned: 0 in 0.825s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.546d2007-3af7-4858-8388-3653f334a2ee {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:27 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.546d2007-3af7-4858-8388-3653f334a2ee Apr 29 17:22:27 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:28 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653.546d2007-3af7-4858-8388-3653f334a2ee" returned: 0 in 0.644s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-546d2007-3af7-4858-8388-3653f334a2ee" released by "_delete_snapshot" :: held 3.517s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:22:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-3727e521-c284-4b68-a3c6-3aa4b97a7653" released by "delete_snapshot" :: held 3.550s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:22:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "cinder-quobyte-ac1ce6ab-8334-42d3-9429-542af6c64d0d" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:22:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-ac1ce6ab-8334-42d3-9429-542af6c64d0d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:22:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "cinder-quobyte-5eef3ef0-f7c8-4cd2-b1bd-704be304f085" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:22:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-5eef3ef0-f7c8-4cd2-b1bd-704be304f085" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:22:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Deleting offline snapshot 5eef3ef0-f7c8-4cd2-b1bd-704be304f085 of volume ac1ce6ab-8334-42d3-9429-542af6c64d0d {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:22:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] snapshot_file for this snap is: volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.5eef3ef0-f7c8-4cd2-b1bd-704be304f085 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:22:28 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf62caa8-c88b-4c6a-b418-1748518632b0]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.5eef3ef0-f7c8-4cd2-b1bd-704be304f085 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5b8901a9-7765-40d9-a78a-49446564f0b1 tempest-VolumesTransfersV357Test-402320391 None] Acquiring lock "cinder-40b584e8-cef9-4cfc-9d62-9d8f3009dcde-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:22:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5b8901a9-7765-40d9-a78a-49446564f0b1 tempest-VolumesTransfersV357Test-402320391 None] Lock "cinder-40b584e8-cef9-4cfc-9d62-9d8f3009dcde-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:22:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5b8901a9-7765-40d9-a78a-49446564f0b1 tempest-VolumesTransfersV357Test-402320391 None] Acquiring lock "cinder-quobyte-40b584e8-cef9-4cfc-9d62-9d8f3009dcde" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:22:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5b8901a9-7765-40d9-a78a-49446564f0b1 tempest-VolumesTransfersV357Test-402320391 None] Lock "cinder-quobyte-40b584e8-cef9-4cfc-9d62-9d8f3009dcde" acquired by "delete_volume" :: waited 0.015s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:22:28 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.5eef3ef0-f7c8-4cd2-b1bd-704be304f085 Apr 29 17:22:28 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:28 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc3e081-6680-45a8-bfa9-037f5ce8a9f3]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5b8901a9-7765-40d9-a78a-49446564f0b1 tempest-VolumesTransfersV357Test-402320391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-40b584e8-cef9-4cfc-9d62-9d8f3009dcde {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:28 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-40b584e8-cef9-4cfc-9d62-9d8f3009dcde Apr 29 17:22:28 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:29 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.5eef3ef0-f7c8-4cd2-b1bd-704be304f085" returned: 0 in 0.816s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:22:29 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[473ec151-b1cb-416e-89be-64ee6506c65e]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:29 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5b8901a9-7765-40d9-a78a-49446564f0b1 tempest-VolumesTransfersV357Test-402320391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-40b584e8-cef9-4cfc-9d62-9d8f3009dcde" returned: 0 in 0.823s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5b8901a9-7765-40d9-a78a-49446564f0b1 tempest-VolumesTransfersV357Test-402320391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-40b584e8-cef9-4cfc-9d62-9d8f3009dcde {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:29 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d Apr 29 17:22:29 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:29 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-40b584e8-cef9-4cfc-9d62-9d8f3009dcde Apr 29 17:22:29 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:29 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:22:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Flow 'volume_create_manager' (35f560e9-06f7-42b0-b586-30ed64e61a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:22:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84b939e-28c8-4a5a-adda-6ecadc0a6415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84b939e-28c8-4a5a-adda-6ecadc0a6415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-701127153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2eacba-7e88-4915-b72a-3ab9ffeaa769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757697e5832e410d946bafe668e93ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:22:30Z,use_quota=True,user_id='0ef4ba5e767a4b26b6279e5836013882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7cff869-8e91-4108-a51d-2f543fe07b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7cff869-8e91-4108-a51d-2f543fe07b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf72e2e-25a0-4a51-b525-798a6558ce8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf72e2e-25a0-4a51-b525-798a6558ce8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c2eacba-7e88-4915-b72a-3ab9ffeaa769', 'volume_name': 'volume-1c2eacba-7e88-4915-b72a-3ab9ffeaa769', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b0d149-7d60-4479-9423-2db4d7806abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b0d149-7d60-4479-9423-2db4d7806abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (742950d9-860c-41f5-886a-2e203cc50bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:30 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Volume 1c2eacba-7e88-4915-b72a-3ab9ffeaa769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c2eacba-7e88-4915-b72a-3ab9ffeaa769', 'volume_size': 1} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-701127153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2eacba-7e88-4915-b72a-3ab9ffeaa769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='757697e5832e410d946bafe668e93ec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:22:30Z,use_quota=True,user_id='0ef4ba5e767a4b26b6279e5836013882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Creating volume 1c2eacba-7e88-4915-b72a-3ab9ffeaa769 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:22:30 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c2eacba-7e88-4915-b72a-3ab9ffeaa769 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:30 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c2eacba-7e88-4915-b72a-3ab9ffeaa769 1073741824 Apr 29 17:22:30 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:30 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5b8901a9-7765-40d9-a78a-49446564f0b1 tempest-VolumesTransfersV357Test-402320391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-40b584e8-cef9-4cfc-9d62-9d8f3009dcde" returned: 0 in 0.642s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5b8901a9-7765-40d9-a78a-49446564f0b1 tempest-VolumesTransfersV357Test-402320391 None] Lock "cinder-quobyte-40b584e8-cef9-4cfc-9d62-9d8f3009dcde" released by "delete_volume" :: held 1.528s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:22:30 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d" returned: 0 in 0.804s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.5eef3ef0-f7c8-4cd2-b1bd-704be304f085 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:30 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.5eef3ef0-f7c8-4cd2-b1bd-704be304f085 Apr 29 17:22:30 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-5b8901a9-7765-40d9-a78a-49446564f0b1 tempest-VolumesTransfersV357Test-402320391 None] Created reservations ['35ee3ae1-11de-4808-ac62-b5ac3eb08fc7', '50be17f9-03ce-40ad-bc9d-2c04e6d82f37', '916bbe10-a7b7-4e11-887d-73286e661944', '68eeb96f-6247-4361-bc54-f9c825c68621'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5b8901a9-7765-40d9-a78a-49446564f0b1 tempest-VolumesTransfersV357Test-402320391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5b8901a9-7765-40d9-a78a-49446564f0b1 tempest-VolumesTransfersV357Test-402320391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-5b8901a9-7765-40d9-a78a-49446564f0b1 tempest-VolumesTransfersV357Test-402320391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-5b8901a9-7765-40d9-a78a-49446564f0b1 tempest-VolumesTransfersV357Test-402320391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5b8901a9-7765-40d9-a78a-49446564f0b1 tempest-VolumesTransfersV357Test-402320391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5b8901a9-7765-40d9-a78a-49446564f0b1 tempest-VolumesTransfersV357Test-402320391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:30 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:22:30 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:30 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c2eacba-7e88-4915-b72a-3ab9ffeaa769 1073741824" returned: 0 in 0.824s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c2eacba-7e88-4915-b72a-3ab9ffeaa769 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:30 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c2eacba-7e88-4915-b72a-3ab9ffeaa769 Apr 29 17:22:30 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:31 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5b8901a9-7765-40d9-a78a-49446564f0b1 tempest-VolumesTransfersV357Test-402320391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.724s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-5b8901a9-7765-40d9-a78a-49446564f0b1 tempest-VolumesTransfersV357Test-402320391 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:22:31 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-5b8901a9-7765-40d9-a78a-49446564f0b1 tempest-VolumesTransfersV357Test-402320391 None] Deleted volume successfully. Apr 29 17:22:31 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.5eef3ef0-f7c8-4cd2-b1bd-704be304f085" returned: 0 in 0.876s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.5eef3ef0-f7c8-4cd2-b1bd-704be304f085 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5b8901a9-7765-40d9-a78a-49446564f0b1 tempest-VolumesTransfersV357Test-402320391 None] Lock "cinder-40b584e8-cef9-4cfc-9d62-9d8f3009dcde-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:22:31 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.5eef3ef0-f7c8-4cd2-b1bd-704be304f085 Apr 29 17:22:31 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Flow 'volume_create_manager' (15ecd5f7-47cf-4006-9afb-940a6cbf5042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5536fe4b-be0f-414e-8d28-b3845fe5c8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5536fe4b-be0f-414e-8d28-b3845fe5c8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1670490092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97b6df9c-35bb-4809-8267-0b3c2ed65d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e4162c946a42c0968fe6315122c35f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:22:32Z,use_quota=True,user_id='f11bdb038c304b4abd4201b2ebada510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b53b8b8-ded1-4765-b38f-716c40ae667c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b53b8b8-ded1-4765-b38f-716c40ae667c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b13c8ca-0fef-4435-82e8-169e98504879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b13c8ca-0fef-4435-82e8-169e98504879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97b6df9c-35bb-4809-8267-0b3c2ed65d47', 'volume_name': 'volume-97b6df9c-35bb-4809-8267-0b3c2ed65d47', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac41d5c-6d19-44ec-80f5-c6c9122b2c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ac41d5c-6d19-44ec-80f5-c6c9122b2c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff81603-a78f-4811-bda3-6da5f89ff2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:31 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Volume 97b6df9c-35bb-4809-8267-0b3c2ed65d47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97b6df9c-35bb-4809-8267-0b3c2ed65d47', 'volume_size': 1} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:31 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c2eacba-7e88-4915-b72a-3ab9ffeaa769" returned: 0 in 0.761s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.044s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1670490092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97b6df9c-35bb-4809-8267-0b3c2ed65d47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27e4162c946a42c0968fe6315122c35f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:22:32Z,use_quota=True,user_id='f11bdb038c304b4abd4201b2ebada510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Creating volume 97b6df9c-35bb-4809-8267-0b3c2ed65d47 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:22:31 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-97b6df9c-35bb-4809-8267-0b3c2ed65d47 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (742950d9-860c-41f5-886a-2e203cc50bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c2eacba-7e88-4915-b72a-3ab9ffeaa769', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f10f4f72-5883-4a3d-a1bb-21d3300cf998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:31 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-97b6df9c-35bb-4809-8267-0b3c2ed65d47 1073741824 Apr 29 17:22:31 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:31 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Volume volume-1c2eacba-7e88-4915-b72a-3ab9ffeaa769 (1c2eacba-7e88-4915-b72a-3ab9ffeaa769): created successfully Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f10f4f72-5883-4a3d-a1bb-21d3300cf998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Flow 'volume_create_manager' (35f560e9-06f7-42b0-b586-30ed64e61a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:22:31 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-92bc0a00-fe97-45c4-89ab-e4bd22df5fc2 tempest-AttachVolumeTestJSON-602814825 None] Created volume successfully. Apr 29 17:22:31 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d.5eef3ef0-f7c8-4cd2-b1bd-704be304f085" returned: 0 in 0.681s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-5eef3ef0-f7c8-4cd2-b1bd-704be304f085" released by "_delete_snapshot" :: held 3.297s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:22:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-ac1ce6ab-8334-42d3-9429-542af6c64d0d" released by "delete_snapshot" :: held 3.323s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:22:32 devstack cinder-volume[84547]: WARNING cinder.quota [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1699985958 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1699985958, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:22:32 devstack cinder-volume[84547]: WARNING cinder.quota [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1699985958 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1699985958, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:22:32 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Created reservations ['5569d59d-2302-40d5-b16d-08d7769b3d36', '177ba119-705a-4f44-9e13-8b828cc5c2f5', '4df282f7-1ab9-4d62-9c62-37b93574caa7', '5cb85f82-e3df-4d5a-8243-1495b53b9bd9'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:22:32 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] Created reservations ['adfbaab3-0556-400d-b5b3-ce7315ede549', '20c10541-9a26-46f0-8a48-ae8e8e7986a0', '4d6f4bc0-27f6-4aea-b522-e007e3eb5695', '0bee12a3-436f-4ba0-a8b3-b377ce2df4ba'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:22:32 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-7ed27063-b951-426a-9801-0cc8df55b3a1 tempest-GroupSnapshotsTest-1478505142 None] group_snapshot 4acda4a4-6bd4-4165-a4a8-62334d4072b1: deleted successfully Apr 29 17:22:32 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-97b6df9c-35bb-4809-8267-0b3c2ed65d47 1073741824" returned: 0 in 0.965s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-97b6df9c-35bb-4809-8267-0b3c2ed65d47 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:32 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-97b6df9c-35bb-4809-8267-0b3c2ed65d47 Apr 29 17:22:32 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "cinder-quobyte-3727e521-c284-4b68-a3c6-3aa4b97a7653" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:22:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-3727e521-c284-4b68-a3c6-3aa4b97a7653" acquired by "delete_volume" :: waited 0.027s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:22:32 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d6280c-ad55-4127-86d6-d85024f27c66]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:33 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653 Apr 29 17:22:33 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:33 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-97b6df9c-35bb-4809-8267-0b3c2ed65d47" returned: 0 in 0.697s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:22:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff81603-a78f-4811-bda3-6da5f89ff2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97b6df9c-35bb-4809-8267-0b3c2ed65d47', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71185831-7501-4230-a38e-c1ffd50bef08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:33 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Volume volume-97b6df9c-35bb-4809-8267-0b3c2ed65d47 (97b6df9c-35bb-4809-8267-0b3c2ed65d47): created successfully Apr 29 17:22:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71185831-7501-4230-a38e-c1ffd50bef08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Flow 'volume_create_manager' (15ecd5f7-47cf-4006-9afb-940a6cbf5042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:22:33 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-a6875979-d745-4e94-b78b-5077380dc2fe tempest-VolumesTransfersV357Test-1695003754 None] Created volume successfully. Apr 29 17:22:33 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653" returned: 0 in 0.826s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:33 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653 Apr 29 17:22:33 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6b510362-0750-48ae-b2be-c1892b768dcc tempest-VolumesTransfersV357Test-402320391 None] Acquiring lock "cinder-97b6df9c-35bb-4809-8267-0b3c2ed65d47-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:22:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6b510362-0750-48ae-b2be-c1892b768dcc tempest-VolumesTransfersV357Test-402320391 None] Lock "cinder-97b6df9c-35bb-4809-8267-0b3c2ed65d47-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:22:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6b510362-0750-48ae-b2be-c1892b768dcc tempest-VolumesTransfersV357Test-402320391 None] Acquiring lock "cinder-quobyte-97b6df9c-35bb-4809-8267-0b3c2ed65d47" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:22:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6b510362-0750-48ae-b2be-c1892b768dcc tempest-VolumesTransfersV357Test-402320391 None] Lock "cinder-quobyte-97b6df9c-35bb-4809-8267-0b3c2ed65d47" acquired by "delete_volume" :: waited 0.027s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:22:34 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d73b63d-8791-4eb2-bc44-744389eb957d]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6b510362-0750-48ae-b2be-c1892b768dcc tempest-VolumesTransfersV357Test-402320391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-97b6df9c-35bb-4809-8267-0b3c2ed65d47 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:34 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-97b6df9c-35bb-4809-8267-0b3c2ed65d47 Apr 29 17:22:34 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:34 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3727e521-c284-4b68-a3c6-3aa4b97a7653" returned: 0 in 0.865s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-3727e521-c284-4b68-a3c6-3aa4b97a7653" released by "delete_volume" :: held 1.765s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:22:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "cinder-quobyte-ac1ce6ab-8334-42d3-9429-542af6c64d0d" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:22:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-ac1ce6ab-8334-42d3-9429-542af6c64d0d" acquired by "delete_volume" :: waited 0.018s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:22:34 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39da00d-a2dd-465c-ade0-cea7192f281c]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:34 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d Apr 29 17:22:34 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:35 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6b510362-0750-48ae-b2be-c1892b768dcc tempest-VolumesTransfersV357Test-402320391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-97b6df9c-35bb-4809-8267-0b3c2ed65d47" returned: 0 in 1.059s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6b510362-0750-48ae-b2be-c1892b768dcc tempest-VolumesTransfersV357Test-402320391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-97b6df9c-35bb-4809-8267-0b3c2ed65d47 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:35 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-97b6df9c-35bb-4809-8267-0b3c2ed65d47 Apr 29 17:22:35 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-62e1dc88-2a7c-4a13-a338-62b3dd67d1dc req-ae1be8c0-0d95-4e5f-8ef9-5cd20dd04c59 tempest-AttachVolumeTestJSON-602814825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-62e1dc88-2a7c-4a13-a338-62b3dd67d1dc req-ae1be8c0-0d95-4e5f-8ef9-5cd20dd04c59 tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:35 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccb88f5-47e5-40bc-be8f-25a8d7022668]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-62e1dc88-2a7c-4a13-a338-62b3dd67d1dc req-ae1be8c0-0d95-4e5f-8ef9-5cd20dd04c59 tempest-AttachVolumeTestJSON-602814825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c2eacba-7e88-4915-b72a-3ab9ffeaa769 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:35 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c2eacba-7e88-4915-b72a-3ab9ffeaa769 Apr 29 17:22:35 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:35 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d" returned: 0 in 1.107s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:35 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d Apr 29 17:22:35 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:36 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6b510362-0750-48ae-b2be-c1892b768dcc tempest-VolumesTransfersV357Test-402320391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-97b6df9c-35bb-4809-8267-0b3c2ed65d47" returned: 0 in 0.942s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:36 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6b510362-0750-48ae-b2be-c1892b768dcc tempest-VolumesTransfersV357Test-402320391 None] Lock "cinder-quobyte-97b6df9c-35bb-4809-8267-0b3c2ed65d47" released by "delete_volume" :: held 2.070s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:22:36 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-6b510362-0750-48ae-b2be-c1892b768dcc tempest-VolumesTransfersV357Test-402320391 None] Created reservations ['7816bebd-5342-4e61-a468-9329ee2cc167', 'af7079cb-7325-4c3a-aa02-6f838a0b58a2', 'cc634fe9-42a0-493a-a659-f15621688e82', '79de2c58-0368-4a69-8bf7-b914e7c9f2e9'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:22:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6b510362-0750-48ae-b2be-c1892b768dcc tempest-VolumesTransfersV357Test-402320391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6b510362-0750-48ae-b2be-c1892b768dcc tempest-VolumesTransfersV357Test-402320391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:36 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-6b510362-0750-48ae-b2be-c1892b768dcc tempest-VolumesTransfersV357Test-402320391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:22:36 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-6b510362-0750-48ae-b2be-c1892b768dcc tempest-VolumesTransfersV357Test-402320391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:22:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6b510362-0750-48ae-b2be-c1892b768dcc tempest-VolumesTransfersV357Test-402320391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6b510362-0750-48ae-b2be-c1892b768dcc tempest-VolumesTransfersV357Test-402320391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:36 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-62e1dc88-2a7c-4a13-a338-62b3dd67d1dc req-ae1be8c0-0d95-4e5f-8ef9-5cd20dd04c59 tempest-AttachVolumeTestJSON-602814825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c2eacba-7e88-4915-b72a-3ab9ffeaa769" returned: 0 in 0.910s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-62e1dc88-2a7c-4a13-a338-62b3dd67d1dc req-ae1be8c0-0d95-4e5f-8ef9-5cd20dd04c59 tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.942s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:36 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:22:36 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-62e1dc88-2a7c-4a13-a338-62b3dd67d1dc req-ae1be8c0-0d95-4e5f-8ef9-5cd20dd04c59 tempest-AttachVolumeTestJSON-602814825 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-1c2eacba-7e88-4915-b72a-3ab9ffeaa769', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c531ed0-b64a-4181-b460-abda05d15b00', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:22:36 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-62e1dc88-2a7c-4a13-a338-62b3dd67d1dc req-ae1be8c0-0d95-4e5f-8ef9-5cd20dd04c59 tempest-AttachVolumeTestJSON-602814825 None] attachment_update completed successfully. Apr 29 17:22:36 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1ce6ab-8334-42d3-9429-542af6c64d0d" returned: 0 in 0.810s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:36 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-ac1ce6ab-8334-42d3-9429-542af6c64d0d" released by "delete_volume" :: held 2.002s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:22:36 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Created reservations ['65acc985-c9ec-4c78-87ce-f10e66c2cd8e'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:22:36 devstack cinder-volume[84547]: WARNING cinder.quota [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1699985958 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1699985958, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:22:36 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Created reservations ['1ccdbc05-7fb3-4f38-adcd-9825f6dba4a9', '3ab87e0a-0acf-42d0-b2bb-e1f4ec0cebe0', 'f62fc25c-e415-4441-8714-eab84a745887', '87267139-2e5b-4725-888b-c08dd1c688e8'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:22:36 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Created reservations ['9ea4c061-ced9-455a-9083-6a1cb332e586', '819e2662-c287-41a5-9d45-fb47debf8480', '76d7da28-e79d-4563-8f1d-9702db2f8ce3', '27420e2f-0d58-43d3-95da-f1ca8fd56654'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:22:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:22:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:22:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:37 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6b510362-0750-48ae-b2be-c1892b768dcc tempest-VolumesTransfersV357Test-402320391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.781s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:37 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-6b510362-0750-48ae-b2be-c1892b768dcc tempest-VolumesTransfersV357Test-402320391 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:22:37 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-6b510362-0750-48ae-b2be-c1892b768dcc tempest-VolumesTransfersV357Test-402320391 None] Deleted volume successfully. Apr 29 17:22:37 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:22:37 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:37 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6b510362-0750-48ae-b2be-c1892b768dcc tempest-VolumesTransfersV357Test-402320391 None] Lock "cinder-97b6df9c-35bb-4809-8267-0b3c2ed65d47-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:22:37 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ffda0a6b-a8f4-410c-8db7-18fc2531e944 tempest-GroupSnapshotsTest-1478505142 None] Group tempest-GroupSnapshotsTest-Group-1431533089: creating Apr 29 17:22:37 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ffda0a6b-a8f4-410c-8db7-18fc2531e944 tempest-GroupSnapshotsTest-1478505142 None] Group tempest-GroupSnapshotsTest-Group-1431533089: created successfully Apr 29 17:22:37 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ffda0a6b-a8f4-410c-8db7-18fc2531e944 tempest-GroupSnapshotsTest-1478505142 None] Create group completed successfully. Apr 29 17:22:37 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.805s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:37 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:22:37 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-c1aa1ddf-a34f-4ed4-93a9-7e5806e61f11 tempest-GroupSnapshotsTest-1478505142 None] Delete group completed successfully. Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Flow 'volume_create_manager' (50571dd6-fea2-461a-814c-bf8e0598779a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750cdcab-dcfa-4f68-91ea-4d4fb587fcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (750cdcab-dcfa-4f68-91ea-4d4fb587fcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2081801835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3b441168-aaf7-4d97-be79-b8d68a87eba5,host='devstack@QuobyteHD#QuobyteHD',id=7c96fcf6-df7e-4af7-a8f2-f5ee299f134e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f11acad828d4ee2aa016f60ecda733d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:22:40Z,use_quota=True,user_id='5f9a5af157254c67ab571291e3ba3fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1735bef7-faac-4b59-95f2-fa9cd0a526c3),volume_type_id=1735bef7-faac-4b59-95f2-fa9cd0a526c3)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17bfe44-98fd-4213-b698-34d52ece40b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a17bfe44-98fd-4213-b698-34d52ece40b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84344a0-55bd-4ba6-ae50-ed42276b361f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84344a0-55bd-4ba6-ae50-ed42276b361f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c96fcf6-df7e-4af7-a8f2-f5ee299f134e', 'volume_name': 'volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3287ca29-7aaf-4c0b-ba14-83ca94687cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3287ca29-7aaf-4c0b-ba14-83ca94687cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76148483-d1c3-4d4e-9b63-8f22d9c2b09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:39 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Volume 7c96fcf6-df7e-4af7-a8f2-f5ee299f134e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e', 'volume_size': 1} Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3b441168-aaf7-4d97-be79-b8d68a87eba5,created_at=2026-04-29T15:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2081801835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3b441168-aaf7-4d97-be79-b8d68a87eba5,host='devstack@QuobyteHD#QuobyteHD',id=7c96fcf6-df7e-4af7-a8f2-f5ee299f134e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f11acad828d4ee2aa016f60ecda733d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:22:40Z,use_quota=True,user_id='5f9a5af157254c67ab571291e3ba3fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1735bef7-faac-4b59-95f2-fa9cd0a526c3),volume_type_id=1735bef7-faac-4b59-95f2-fa9cd0a526c3)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Creating volume 7c96fcf6-df7e-4af7-a8f2-f5ee299f134e {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:22:39 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:22:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:39 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e 1073741824 Apr 29 17:22:39 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:40 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e 1073741824" returned: 0 in 0.941s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:40 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e Apr 29 17:22:40 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:41 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e" returned: 0 in 0.627s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:41 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:22:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76148483-d1c3-4d4e-9b63-8f22d9c2b09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3785235d-2891-4ee1-82ef-496aa63ecbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:41 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Volume volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e (7c96fcf6-df7e-4af7-a8f2-f5ee299f134e): created successfully Apr 29 17:22:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3785235d-2891-4ee1-82ef-496aa63ecbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Flow 'volume_create_manager' (50571dd6-fea2-461a-814c-bf8e0598779a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:22:41 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-25e171f7-a54b-4d32-aac3-2463f28f3a3c tempest-GroupSnapshotsTest-1478505142 None] Created volume successfully. Apr 29 17:22:42 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] GroupSnapshot ec43e081-ec43-42c6-91a9-fdcf61c1c505: creating. Apr 29 17:22:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] Group snapshot ec43e081-ec43-42c6-91a9-fdcf61c1c505: creating. {{(pid=84547) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 17:22:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:42 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] Creating offline snapshot 1caab641-a181-46c4-b214-cd1531516480 of volume 7c96fcf6-df7e-4af7-a8f2-f5ee299f134e {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:22:42 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b60babc-fb60-4f96-8196-ee9976d997e6]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:42 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e Apr 29 17:22:42 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:43 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e" returned: 0 in 1.009s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.1caab641-a181-46c4-b214-cd1531516480 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:43 devstack sudo[100922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.1caab641-a181-46c4-b214-cd1531516480 1G Apr 29 17:22:43 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:43 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-f6bfeec3-14cc-485a-98ee-b8f9d5f01e3c req-2577218a-af3b-4411-9ee2-081edffc67f9 tempest-AttachVolumeTestJSON-602814825 None] Terminate volume connection completed successfully. Apr 29 17:22:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f6bfeec3-14cc-485a-98ee-b8f9d5f01e3c req-2577218a-af3b-4411-9ee2-081edffc67f9 tempest-AttachVolumeTestJSON-602814825 None] Deleting attachment 10802f2a-ca6f-4859-857e-6a77624fe758. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:22:44 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.1caab641-a181-46c4-b214-cd1531516480 1G" returned: 0 in 1.006s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.1caab641-a181-46c4-b214-cd1531516480 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:44 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.1caab641-a181-46c4-b214-cd1531516480 Apr 29 17:22:44 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:44 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:22:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Flow 'volume_create_manager' (22f56119-e7fd-4e42-86ca-14aa737c136e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:22:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d6fa9c-06a9-4c90-952f-0f0e3c5f71b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d6fa9c-06a9-4c90-952f-0f0e3c5f71b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1992431551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c9cc4b4-9324-4c63-a28f-37618d29187a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6909bd8deb584ef3bfa4a5f44c87c1ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:22:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:22:45Z,use_quota=True,user_id='b078798cf3af4a84b470063fc7723db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4026819f-9c04-4b73-88f4-66e83279278d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4026819f-9c04-4b73-88f4-66e83279278d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950d823c-9f35-4546-b2fa-a72724be1d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950d823c-9f35-4546-b2fa-a72724be1d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c9cc4b4-9324-4c63-a28f-37618d29187a', 'volume_name': 'volume-2c9cc4b4-9324-4c63-a28f-37618d29187a', 'volume_size': 2}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc1127a6-e34a-465a-ab65-4ae019ad5ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc1127a6-e34a-465a-ab65-4ae019ad5ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a9ef7d-2069-4135-b6f4-301178a2c13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:44 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Volume 2c9cc4b4-9324-4c63-a28f-37618d29187a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c9cc4b4-9324-4c63-a28f-37618d29187a', 'volume_size': 2} Apr 29 17:22:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:45 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.1caab641-a181-46c4-b214-cd1531516480" returned: 0 in 0.740s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:45 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.1caab641-a181-46c4-b214-cd1531516480 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 17:22:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.1caab641-a181-46c4-b214-cd1531516480 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:45 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.1caab641-a181-46c4-b214-cd1531516480 Apr 29 17:22:45 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:45 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.1caab641-a181-46c4-b214-cd1531516480" returned: 0 in 0.607s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:45 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.info Apr 29 17:22:45 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:46 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-41a9191d-ce8a-4908-a527-f7919b87445d req-f5f39786-03c7-437c-a3b5-80f9597b0e83 tempest-AttachVolumeTestJSON-602814825 None] Terminate volume connection completed successfully. Apr 29 17:22:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-41a9191d-ce8a-4908-a527-f7919b87445d req-f5f39786-03c7-437c-a3b5-80f9597b0e83 tempest-AttachVolumeTestJSON-602814825 None] Deleting attachment 9c531ed0-b64a-4181-b460-abda05d15b00. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:22:46 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.info" returned: 0 in 0.657s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:46 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 17:22:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:46 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.info Apr 29 17:22:46 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:47 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.info" returned: 0 in 0.645s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.784s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.343s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1992431551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c9cc4b4-9324-4c63-a28f-37618d29187a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6909bd8deb584ef3bfa4a5f44c87c1ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:22:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:22:45Z,use_quota=True,user_id='b078798cf3af4a84b470063fc7723db3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Creating volume 2c9cc4b4-9324-4c63-a28f-37618d29187a {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:22:47 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a 2147483648 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:47 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a 2147483648 Apr 29 17:22:47 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:47 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4dddb7bd-a93e-456b-8fbe-23b414620272 tempest-GroupSnapshotsTest-1478505142 None] group_snapshot ec43e081-ec43-42c6-91a9-fdcf61c1c505: created successfully Apr 29 17:22:47 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] group_snapshot ec43e081-ec43-42c6-91a9-fdcf61c1c505: deleting Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] group_snapshot ec43e081-ec43-42c6-91a9-fdcf61c1c505: deleting {{(pid=84547) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "cinder-quobyte-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "cinder-quobyte-1caab641-a181-46c4-b214-cd1531516480" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-1caab641-a181-46c4-b214-cd1531516480" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] Deleting offline snapshot 1caab641-a181-46c4-b214-cd1531516480 of volume 7c96fcf6-df7e-4af7-a8f2-f5ee299f134e {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] snapshot_file for this snap is: volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.1caab641-a181-46c4-b214-cd1531516480 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f15bfe-0e81-45ee-a95e-22b6d7c7a65b]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.1caab641-a181-46c4-b214-cd1531516480 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:48 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a 2147483648" returned: 0 in 0.962s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:48 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.1caab641-a181-46c4-b214-cd1531516480 Apr 29 17:22:48 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:48 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a Apr 29 17:22:48 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:48 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a" returned: 0 in 0.711s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:22:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:48 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a9ef7d-2069-4135-b6f4-301178a2c13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c9cc4b4-9324-4c63-a28f-37618d29187a', 'volume_size': 2}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072d9ef8-03ce-4d7a-9d02-bd3ecda553d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:22:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.1caab641-a181-46c4-b214-cd1531516480" returned: 0 in 0.911s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:22:48 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bb7904-3d66-4948-8be3-4e1a98f17423]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:48 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Volume volume-2c9cc4b4-9324-4c63-a28f-37618d29187a (2c9cc4b4-9324-4c63-a28f-37618d29187a): created successfully Apr 29 17:22:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072d9ef8-03ce-4d7a-9d02-bd3ecda553d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:22:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Flow 'volume_create_manager' (22f56119-e7fd-4e42-86ca-14aa737c136e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:22:48 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-fbb57db6-d6e8-4d85-a023-396090e612ea tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Created volume successfully. Apr 29 17:22:48 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e Apr 29 17:22:48 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:50 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e" returned: 0 in 1.273s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.1caab641-a181-46c4-b214-cd1531516480 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:50 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.1caab641-a181-46c4-b214-cd1531516480 Apr 29 17:22:50 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-353422a1-35d9-4cca-be45-da86c672bdc2 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-353422a1-35d9-4cca-be45-da86c672bdc2 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-353422a1-35d9-4cca-be45-da86c672bdc2 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Creating offline snapshot 934b7a50-7fdf-4755-a952-5b529ee33325 of volume 2c9cc4b4-9324-4c63-a28f-37618d29187a {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:22:50 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c302cf-2211-4d0e-9516-36fbeb965551]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-353422a1-35d9-4cca-be45-da86c672bdc2 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:50 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a Apr 29 17:22:50 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:51 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.1caab641-a181-46c4-b214-cd1531516480" returned: 0 in 1.234s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.1caab641-a181-46c4-b214-cd1531516480 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:51 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.1caab641-a181-46c4-b214-cd1531516480 Apr 29 17:22:51 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:51 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-353422a1-35d9-4cca-be45-da86c672bdc2 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a" returned: 0 in 1.356s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-353422a1-35d9-4cca-be45-da86c672bdc2 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.934b7a50-7fdf-4755-a952-5b529ee33325 2G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:51 devstack sudo[101133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.934b7a50-7fdf-4755-a952-5b529ee33325 2G Apr 29 17:22:51 devstack sudo[101133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:52 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e.1caab641-a181-46c4-b214-cd1531516480" returned: 0 in 1.079s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-1caab641-a181-46c4-b214-cd1531516480" released by "_delete_snapshot" :: held 4.662s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:22:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e" released by "delete_snapshot" :: held 4.694s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:22:52 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=131,cinder:SELECT=135,cinder:INSERT=35,cinder:DELETE=7 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:22:52 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:INSERT=36,cinder:SELECT=139,cinder:UPDATE=136,cinder:DELETE=7 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:22:52 devstack cinder-volume[84547]: WARNING cinder.quota [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1219316044 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1219316044, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:22:52 devstack cinder-volume[84547]: WARNING cinder.quota [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1219316044 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1219316044, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:22:52 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] Created reservations ['078a158a-fc28-41de-b038-ea7b74cc0c61', '5bfdd069-c4dd-4380-8abf-44514136fb9d', 'c4252e1b-4268-4906-a486-28ec559d624d', 'a144e83c-f340-474c-b42f-be99dd1dd978'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:22:52 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-56882820-2318-45d6-8d34-24b43f2040f0 tempest-GroupSnapshotsTest-1478505142 None] group_snapshot ec43e081-ec43-42c6-91a9-fdcf61c1c505: deleted successfully Apr 29 17:22:53 devstack sudo[101133]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-353422a1-35d9-4cca-be45-da86c672bdc2 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.934b7a50-7fdf-4755-a952-5b529ee33325 2G" returned: 0 in 1.747s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-353422a1-35d9-4cca-be45-da86c672bdc2 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c9cc4b4-9324-4c63-a28f-37618d29187a -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.934b7a50-7fdf-4755-a952-5b529ee33325 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:53 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c9cc4b4-9324-4c63-a28f-37618d29187a -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.934b7a50-7fdf-4755-a952-5b529ee33325 Apr 29 17:22:53 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:53 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-571e4983-7ac1-4f3c-a85e-e2bc5d4c8c91 tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "cinder-quobyte-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:22:53 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-571e4983-7ac1-4f3c-a85e-e2bc5d4c8c91 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e" acquired by "delete_volume" :: waited 0.057s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:22:54 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b0a691-7417-4b95-a61a-5b939caf9f22]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-571e4983-7ac1-4f3c-a85e-e2bc5d4c8c91 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:54 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e Apr 29 17:22:54 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:54 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-353422a1-35d9-4cca-be45-da86c672bdc2 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c9cc4b4-9324-4c63-a28f-37618d29187a -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.934b7a50-7fdf-4755-a952-5b529ee33325" returned: 0 in 1.306s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:54 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-353422a1-35d9-4cca-be45-da86c672bdc2 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.934b7a50-7fdf-4755-a952-5b529ee33325 is being set with open permissions: ugo+rw Apr 29 17:22:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-353422a1-35d9-4cca-be45-da86c672bdc2 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.934b7a50-7fdf-4755-a952-5b529ee33325 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:54 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.934b7a50-7fdf-4755-a952-5b529ee33325 Apr 29 17:22:54 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:55 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-571e4983-7ac1-4f3c-a85e-e2bc5d4c8c91 tempest-GroupSnapshotsTest-1478505142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e" returned: 0 in 1.437s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-571e4983-7ac1-4f3c-a85e-e2bc5d4c8c91 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:55 devstack sudo[101200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e Apr 29 17:22:55 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:55 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-353422a1-35d9-4cca-be45-da86c672bdc2 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.934b7a50-7fdf-4755-a952-5b529ee33325" returned: 0 in 1.007s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-353422a1-35d9-4cca-be45-da86c672bdc2 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:55 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.info Apr 29 17:22:55 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:56 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-571e4983-7ac1-4f3c-a85e-e2bc5d4c8c91 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e" returned: 0 in 0.816s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-571e4983-7ac1-4f3c-a85e-e2bc5d4c8c91 tempest-GroupSnapshotsTest-1478505142 None] Lock "cinder-quobyte-7c96fcf6-df7e-4af7-a8f2-f5ee299f134e" released by "delete_volume" :: held 2.418s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:22:56 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-571e4983-7ac1-4f3c-a85e-e2bc5d4c8c91 tempest-GroupSnapshotsTest-1478505142 None] Created reservations ['cf605044-64a5-4e08-a2ac-7fef69b4e70c'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:22:56 devstack cinder-volume[84547]: WARNING cinder.quota [None req-571e4983-7ac1-4f3c-a85e-e2bc5d4c8c91 tempest-GroupSnapshotsTest-1478505142 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1219316044 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1219316044, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:22:56 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-571e4983-7ac1-4f3c-a85e-e2bc5d4c8c91 tempest-GroupSnapshotsTest-1478505142 None] Created reservations ['86490315-eeab-4bf0-8a8f-32c1daa01185', 'c8d07489-27fb-495e-8744-b063bb1a0311', '583ba389-4003-4a81-8aa2-aede81fa5b04', 'd8f90864-7f8d-48a1-88de-8a114751bff3'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:22:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-571e4983-7ac1-4f3c-a85e-e2bc5d4c8c91 tempest-GroupSnapshotsTest-1478505142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:22:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-571e4983-7ac1-4f3c-a85e-e2bc5d4c8c91 tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:22:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-571e4983-7ac1-4f3c-a85e-e2bc5d4c8c91 tempest-GroupSnapshotsTest-1478505142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:22:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-571e4983-7ac1-4f3c-a85e-e2bc5d4c8c91 tempest-GroupSnapshotsTest-1478505142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:22:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-571e4983-7ac1-4f3c-a85e-e2bc5d4c8c91 tempest-GroupSnapshotsTest-1478505142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-571e4983-7ac1-4f3c-a85e-e2bc5d4c8c91 tempest-GroupSnapshotsTest-1478505142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:56 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:22:56 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:56 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-353422a1-35d9-4cca-be45-da86c672bdc2 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.info" returned: 0 in 0.848s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:56 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-353422a1-35d9-4cca-be45-da86c672bdc2 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.info is being set with open permissions: ugo+rw Apr 29 17:22:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-353422a1-35d9-4cca-be45-da86c672bdc2 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:56 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.info Apr 29 17:22:56 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:57 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-571e4983-7ac1-4f3c-a85e-e2bc5d4c8c91 tempest-GroupSnapshotsTest-1478505142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.710s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:57 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-571e4983-7ac1-4f3c-a85e-e2bc5d4c8c91 tempest-GroupSnapshotsTest-1478505142 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:22:57 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-571e4983-7ac1-4f3c-a85e-e2bc5d4c8c91 tempest-GroupSnapshotsTest-1478505142 None] Delete group completed successfully. Apr 29 17:22:57 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-353422a1-35d9-4cca-be45-da86c672bdc2 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.info" returned: 0 in 0.770s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-353422a1-35d9-4cca-be45-da86c672bdc2 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.154s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:22:57 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-353422a1-35d9-4cca-be45-da86c672bdc2 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Create snapshot completed successfully Apr 29 17:22:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Acquiring lock "cinder-934b7a50-7fdf-4755-a952-5b529ee33325-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:22:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Lock "cinder-934b7a50-7fdf-4755-a952-5b529ee33325-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:22:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Acquiring lock "cinder-quobyte-2c9cc4b4-9324-4c63-a28f-37618d29187a" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:22:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Lock "cinder-quobyte-2c9cc4b4-9324-4c63-a28f-37618d29187a" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:22:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Acquiring lock "cinder-quobyte-934b7a50-7fdf-4755-a952-5b529ee33325" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:22:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Lock "cinder-quobyte-934b7a50-7fdf-4755-a952-5b529ee33325" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:22:58 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Deleting offline snapshot 934b7a50-7fdf-4755-a952-5b529ee33325 of volume 2c9cc4b4-9324-4c63-a28f-37618d29187a {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:22:58 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] snapshot_file for this snap is: volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.934b7a50-7fdf-4755-a952-5b529ee33325 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:22:58 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad13e2c-4357-4bba-9fb2-fd8c8f3987be]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.934b7a50-7fdf-4755-a952-5b529ee33325 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:58 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.934b7a50-7fdf-4755-a952-5b529ee33325 Apr 29 17:22:58 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:22:59 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Apr 29 17:22:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.934b7a50-7fdf-4755-a952-5b529ee33325" returned: 0 in 1.152s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:22:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c9cc4b4-9324-4c63-a28f-37618d29187a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:22:59 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcf863d-35ca-41bc-ac1a-951d438f92c9]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:22:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:22:59 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a Apr 29 17:22:59 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6e7ab898-3fbe-46fe-ba4a-2db7987f97e2 tempest-AttachVolumeTestJSON-602814825 None] Acquiring lock "cinder-1c2eacba-7e88-4915-b72a-3ab9ffeaa769-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:23:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6e7ab898-3fbe-46fe-ba4a-2db7987f97e2 tempest-AttachVolumeTestJSON-602814825 None] Lock "cinder-1c2eacba-7e88-4915-b72a-3ab9ffeaa769-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:23:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6e7ab898-3fbe-46fe-ba4a-2db7987f97e2 tempest-AttachVolumeTestJSON-602814825 None] Acquiring lock "cinder-quobyte-1c2eacba-7e88-4915-b72a-3ab9ffeaa769" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:23:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6e7ab898-3fbe-46fe-ba4a-2db7987f97e2 tempest-AttachVolumeTestJSON-602814825 None] Lock "cinder-quobyte-1c2eacba-7e88-4915-b72a-3ab9ffeaa769" acquired by "delete_volume" :: waited 0.044s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:23:00 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[a070fad8-879e-431d-bdc1-47a5f120b864]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:23:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6e7ab898-3fbe-46fe-ba4a-2db7987f97e2 tempest-AttachVolumeTestJSON-602814825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c2eacba-7e88-4915-b72a-3ab9ffeaa769 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:00 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a" returned: 0 in 1.122s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.934b7a50-7fdf-4755-a952-5b529ee33325 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:00 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.934b7a50-7fdf-4755-a952-5b529ee33325 Apr 29 17:23:00 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:00 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c2eacba-7e88-4915-b72a-3ab9ffeaa769 Apr 29 17:23:00 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:01 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6e7ab898-3fbe-46fe-ba4a-2db7987f97e2 tempest-AttachVolumeTestJSON-602814825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c2eacba-7e88-4915-b72a-3ab9ffeaa769" returned: 0 in 0.867s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6e7ab898-3fbe-46fe-ba4a-2db7987f97e2 tempest-AttachVolumeTestJSON-602814825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c2eacba-7e88-4915-b72a-3ab9ffeaa769 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:01 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c2eacba-7e88-4915-b72a-3ab9ffeaa769 Apr 29 17:23:01 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:01 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.934b7a50-7fdf-4755-a952-5b529ee33325" returned: 0 in 0.919s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.934b7a50-7fdf-4755-a952-5b529ee33325 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:01 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.934b7a50-7fdf-4755-a952-5b529ee33325 Apr 29 17:23:01 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:02 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6e7ab898-3fbe-46fe-ba4a-2db7987f97e2 tempest-AttachVolumeTestJSON-602814825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1c2eacba-7e88-4915-b72a-3ab9ffeaa769" returned: 0 in 0.749s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6e7ab898-3fbe-46fe-ba4a-2db7987f97e2 tempest-AttachVolumeTestJSON-602814825 None] Lock "cinder-quobyte-1c2eacba-7e88-4915-b72a-3ab9ffeaa769" released by "delete_volume" :: held 1.681s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:23:02 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:02 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-6e7ab898-3fbe-46fe-ba4a-2db7987f97e2 tempest-AttachVolumeTestJSON-602814825 None] Created reservations ['e08df590-ffe3-4378-8558-6ee471dd4fd1', 'd4977094-acce-49d0-a52b-a4c98fc30307', '60dc2d89-9feb-425a-a369-07de4766f63d', 'd5f7fa57-3d7a-4430-9f76-d0d42184ad46'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:23:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a.934b7a50-7fdf-4755-a952-5b529ee33325" returned: 0 in 0.779s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Lock "cinder-quobyte-934b7a50-7fdf-4755-a952-5b529ee33325" released by "_delete_snapshot" :: held 4.151s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:23:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Lock "cinder-quobyte-2c9cc4b4-9324-4c63-a28f-37618d29187a" released by "delete_snapshot" :: held 4.184s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:23:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6e7ab898-3fbe-46fe-ba4a-2db7987f97e2 tempest-AttachVolumeTestJSON-602814825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6e7ab898-3fbe-46fe-ba4a-2db7987f97e2 tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-6e7ab898-3fbe-46fe-ba4a-2db7987f97e2 tempest-AttachVolumeTestJSON-602814825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:23:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-6e7ab898-3fbe-46fe-ba4a-2db7987f97e2 tempest-AttachVolumeTestJSON-602814825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:23:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6e7ab898-3fbe-46fe-ba4a-2db7987f97e2 tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6e7ab898-3fbe-46fe-ba4a-2db7987f97e2 tempest-AttachVolumeTestJSON-602814825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:02 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:23:02 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:02 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Created reservations ['33105fa1-6ce8-453a-ac1f-9c043120a298', 'f60530a6-3941-4c74-92c4-6a16e8f12717', '082c467e-bdad-450e-897e-4e988e05c687', 'd87b8619-39e6-4bd8-b9db-7c4423186e96'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:23:02 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Delete snapshot completed successfully. Apr 29 17:23:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-53bcde99-327b-466c-8eaa-6522ca2a955a tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Lock "cinder-934b7a50-7fdf-4755-a952-5b529ee33325-delete_snapshot" released by "delete_snapshot" :: held 4.469s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:23:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-986e6b6d-0a6e-4b85-896d-988b2ac16c70 tempest-AttachVolumeTestJSON-602814825 None] Acquiring lock "cinder-de5a9f45-6a69-4232-a7af-4c4321ed1cbb-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:23:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-986e6b6d-0a6e-4b85-896d-988b2ac16c70 tempest-AttachVolumeTestJSON-602814825 None] Lock "cinder-de5a9f45-6a69-4232-a7af-4c4321ed1cbb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:23:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-986e6b6d-0a6e-4b85-896d-988b2ac16c70 tempest-AttachVolumeTestJSON-602814825 None] Acquiring lock "cinder-quobyte-de5a9f45-6a69-4232-a7af-4c4321ed1cbb" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:23:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-986e6b6d-0a6e-4b85-896d-988b2ac16c70 tempest-AttachVolumeTestJSON-602814825 None] Lock "cinder-quobyte-de5a9f45-6a69-4232-a7af-4c4321ed1cbb" acquired by "delete_volume" :: waited 0.024s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:23:03 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[311148c0-b45a-46c7-91a9-b0fe1aec2790]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:23:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-986e6b6d-0a6e-4b85-896d-988b2ac16c70 tempest-AttachVolumeTestJSON-602814825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de5a9f45-6a69-4232-a7af-4c4321ed1cbb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:03 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de5a9f45-6a69-4232-a7af-4c4321ed1cbb Apr 29 17:23:03 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:03 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6e7ab898-3fbe-46fe-ba4a-2db7987f97e2 tempest-AttachVolumeTestJSON-602814825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.844s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:03 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-6e7ab898-3fbe-46fe-ba4a-2db7987f97e2 tempest-AttachVolumeTestJSON-602814825 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:23:03 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-6e7ab898-3fbe-46fe-ba4a-2db7987f97e2 tempest-AttachVolumeTestJSON-602814825 None] Deleted volume successfully. Apr 29 17:23:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6e7ab898-3fbe-46fe-ba4a-2db7987f97e2 tempest-AttachVolumeTestJSON-602814825 None] Lock "cinder-1c2eacba-7e88-4915-b72a-3ab9ffeaa769-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:23:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-35407189-8a65-4421-bc2b-69936ccbe993 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Acquiring lock "cinder-2c9cc4b4-9324-4c63-a28f-37618d29187a-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:23:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-35407189-8a65-4421-bc2b-69936ccbe993 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Lock "cinder-2c9cc4b4-9324-4c63-a28f-37618d29187a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:23:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-35407189-8a65-4421-bc2b-69936ccbe993 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Acquiring lock "cinder-quobyte-2c9cc4b4-9324-4c63-a28f-37618d29187a" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:23:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-35407189-8a65-4421-bc2b-69936ccbe993 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Lock "cinder-quobyte-2c9cc4b4-9324-4c63-a28f-37618d29187a" acquired by "delete_volume" :: waited 0.021s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:23:03 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d52f4f3-e16a-4b98-9633-cfa77d8eebf8]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:23:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-35407189-8a65-4421-bc2b-69936ccbe993 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:03 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-986e6b6d-0a6e-4b85-896d-988b2ac16c70 tempest-AttachVolumeTestJSON-602814825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de5a9f45-6a69-4232-a7af-4c4321ed1cbb" returned: 0 in 0.903s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-986e6b6d-0a6e-4b85-896d-988b2ac16c70 tempest-AttachVolumeTestJSON-602814825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de5a9f45-6a69-4232-a7af-4c4321ed1cbb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:03 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de5a9f45-6a69-4232-a7af-4c4321ed1cbb Apr 29 17:23:03 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:03 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a Apr 29 17:23:03 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:04 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ebb7b3ab-f37e-4f73-bbde-241b80f969a8 tempest-GroupSnapshotsV319Test-545599823 None] Group tempest-GroupSnapshotsV319Test-Group-1588352633: creating Apr 29 17:23:04 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ebb7b3ab-f37e-4f73-bbde-241b80f969a8 tempest-GroupSnapshotsV319Test-545599823 None] Group tempest-GroupSnapshotsV319Test-Group-1588352633: created successfully Apr 29 17:23:04 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ebb7b3ab-f37e-4f73-bbde-241b80f969a8 tempest-GroupSnapshotsV319Test-545599823 None] Create group completed successfully. Apr 29 17:23:04 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-986e6b6d-0a6e-4b85-896d-988b2ac16c70 tempest-AttachVolumeTestJSON-602814825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de5a9f45-6a69-4232-a7af-4c4321ed1cbb" returned: 0 in 0.659s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-986e6b6d-0a6e-4b85-896d-988b2ac16c70 tempest-AttachVolumeTestJSON-602814825 None] Lock "cinder-quobyte-de5a9f45-6a69-4232-a7af-4c4321ed1cbb" released by "delete_volume" :: held 1.631s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:23:04 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-986e6b6d-0a6e-4b85-896d-988b2ac16c70 tempest-AttachVolumeTestJSON-602814825 None] Created reservations ['c03fa331-d3de-4d09-9e76-b8608114cc5a', '8afb3ae8-f96b-45e1-8731-7bbde2d11513', 'b23105af-ea71-4b3b-ba03-1512209da53e', 'fc97daa9-412a-47f1-8fb5-5aff7dbe78d4'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:23:04 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-35407189-8a65-4421-bc2b-69936ccbe993 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a" returned: 0 in 0.798s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-35407189-8a65-4421-bc2b-69936ccbe993 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:04 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a Apr 29 17:23:04 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-986e6b6d-0a6e-4b85-896d-988b2ac16c70 tempest-AttachVolumeTestJSON-602814825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-986e6b6d-0a6e-4b85-896d-988b2ac16c70 tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:04 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-986e6b6d-0a6e-4b85-896d-988b2ac16c70 tempest-AttachVolumeTestJSON-602814825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:23:04 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-986e6b6d-0a6e-4b85-896d-988b2ac16c70 tempest-AttachVolumeTestJSON-602814825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:23:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-986e6b6d-0a6e-4b85-896d-988b2ac16c70 tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-986e6b6d-0a6e-4b85-896d-988b2ac16c70 tempest-AttachVolumeTestJSON-602814825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:04 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:23:04 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-eea98a23-1740-4d4c-95e7-abb82d500168 tempest-AttachVolumeTestJSON-602814825 None] Acquiring lock "cinder-c9c2df04-00ab-4a93-964d-af93ef1757d4-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-eea98a23-1740-4d4c-95e7-abb82d500168 tempest-AttachVolumeTestJSON-602814825 None] Lock "cinder-c9c2df04-00ab-4a93-964d-af93ef1757d4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-eea98a23-1740-4d4c-95e7-abb82d500168 tempest-AttachVolumeTestJSON-602814825 None] Acquiring lock "cinder-quobyte-c9c2df04-00ab-4a93-964d-af93ef1757d4" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-eea98a23-1740-4d4c-95e7-abb82d500168 tempest-AttachVolumeTestJSON-602814825 None] Lock "cinder-quobyte-c9c2df04-00ab-4a93-964d-af93ef1757d4" acquired by "delete_volume" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:23:05 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-35407189-8a65-4421-bc2b-69936ccbe993 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c9cc4b4-9324-4c63-a28f-37618d29187a" returned: 0 in 0.644s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ef84cf-be97-4eef-b3ef-04be33edf710]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-eea98a23-1740-4d4c-95e7-abb82d500168 tempest-AttachVolumeTestJSON-602814825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c9c2df04-00ab-4a93-964d-af93ef1757d4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-35407189-8a65-4421-bc2b-69936ccbe993 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Lock "cinder-quobyte-2c9cc4b4-9324-4c63-a28f-37618d29187a" released by "delete_volume" :: held 1.512s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-35407189-8a65-4421-bc2b-69936ccbe993 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Created reservations ['3ca66d1a-a4bb-441c-b0d7-5910cedb85d4', 'c4ca897f-bb93-453f-8b26-fa5eac49bccf', '9ac9c3c0-8dc1-4b99-afde-f09cc878c7e9', '82957af3-bead-4fea-b480-e37a712fab0a'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:23:05 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-986e6b6d-0a6e-4b85-896d-988b2ac16c70 tempest-AttachVolumeTestJSON-602814825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.655s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-986e6b6d-0a6e-4b85-896d-988b2ac16c70 tempest-AttachVolumeTestJSON-602814825 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:23:05 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-986e6b6d-0a6e-4b85-896d-988b2ac16c70 tempest-AttachVolumeTestJSON-602814825 None] Deleted volume successfully. Apr 29 17:23:05 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c9c2df04-00ab-4a93-964d-af93ef1757d4 Apr 29 17:23:05 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-986e6b6d-0a6e-4b85-896d-988b2ac16c70 tempest-AttachVolumeTestJSON-602814825 None] Lock "cinder-de5a9f45-6a69-4232-a7af-4c4321ed1cbb-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-35407189-8a65-4421-bc2b-69936ccbe993 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-35407189-8a65-4421-bc2b-69936ccbe993 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-35407189-8a65-4421-bc2b-69936ccbe993 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-35407189-8a65-4421-bc2b-69936ccbe993 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-35407189-8a65-4421-bc2b-69936ccbe993 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-35407189-8a65-4421-bc2b-69936ccbe993 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:05 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:23:05 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:05 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:23:05 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:06 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-35407189-8a65-4421-bc2b-69936ccbe993 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.719s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-35407189-8a65-4421-bc2b-69936ccbe993 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:23:06 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-35407189-8a65-4421-bc2b-69936ccbe993 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Deleted volume successfully. Apr 29 17:23:06 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-eea98a23-1740-4d4c-95e7-abb82d500168 tempest-AttachVolumeTestJSON-602814825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c9c2df04-00ab-4a93-964d-af93ef1757d4" returned: 0 in 0.935s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-eea98a23-1740-4d4c-95e7-abb82d500168 tempest-AttachVolumeTestJSON-602814825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c9c2df04-00ab-4a93-964d-af93ef1757d4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:06 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c9c2df04-00ab-4a93-964d-af93ef1757d4 Apr 29 17:23:06 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-35407189-8a65-4421-bc2b-69936ccbe993 tempest-VolumesSnapshotNegativeTestJSON-1210372037 None] Lock "cinder-2c9cc4b4-9324-4c63-a28f-37618d29187a-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Flow 'volume_create_manager' (7552d3d2-714e-4a2e-8733-4e229011c3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989a1ba1-9064-4902-b007-4d52612a10f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989a1ba1-9064-4902-b007-4d52612a10f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-13126379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49c5db1d-e52e-407c-beb4-97c7927335f3,host='devstack@QuobyteHD#QuobyteHD',id=d1a7f3b2-73a3-4091-8c86-68c60c57cfb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb5f7ce8e5664a31a2a2bc270a68de49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:23:06Z,use_quota=True,user_id='cf54df052f9d4bbc9a5a8347cfb5007b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea60a3e-a6d7-4cc8-9237-6bfb23e7371e),volume_type_id=cea60a3e-a6d7-4cc8-9237-6bfb23e7371e)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f19756-213c-48a9-a0f6-219160cef9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f19756-213c-48a9-a0f6-219160cef9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1cc313-1318-4409-ac86-02b2ee453c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d1cc313-1318-4409-ac86-02b2ee453c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1a7f3b2-73a3-4091-8c86-68c60c57cfb7', 'volume_name': 'volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ffc09c-d33b-4f24-a9a8-bc325d29fc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ffc09c-d33b-4f24-a9a8-bc325d29fc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f587e5ce-ec5c-4fc3-9f96-b352325e72e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:06 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Volume d1a7f3b2-73a3-4091-8c86-68c60c57cfb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7', 'volume_size': 1} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=49c5db1d-e52e-407c-beb4-97c7927335f3,created_at=2026-04-29T15:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-13126379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49c5db1d-e52e-407c-beb4-97c7927335f3,host='devstack@QuobyteHD#QuobyteHD',id=d1a7f3b2-73a3-4091-8c86-68c60c57cfb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb5f7ce8e5664a31a2a2bc270a68de49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:23:06Z,use_quota=True,user_id='cf54df052f9d4bbc9a5a8347cfb5007b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea60a3e-a6d7-4cc8-9237-6bfb23e7371e),volume_type_id=cea60a3e-a6d7-4cc8-9237-6bfb23e7371e)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Creating volume d1a7f3b2-73a3-4091-8c86-68c60c57cfb7 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:23:06 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:06 devstack sudo[101297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7 1073741824 Apr 29 17:23:06 devstack sudo[101297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:06 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.872s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:23:06 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-eea98a23-1740-4d4c-95e7-abb82d500168 tempest-AttachVolumeTestJSON-602814825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c9c2df04-00ab-4a93-964d-af93ef1757d4" returned: 0 in 0.689s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-eea98a23-1740-4d4c-95e7-abb82d500168 tempest-AttachVolumeTestJSON-602814825 None] Lock "cinder-quobyte-c9c2df04-00ab-4a93-964d-af93ef1757d4" released by "delete_volume" :: held 1.678s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:23:07 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-eea98a23-1740-4d4c-95e7-abb82d500168 tempest-AttachVolumeTestJSON-602814825 None] Created reservations ['b694ede8-bfbe-4585-a3b6-4ce577a20743', 'feb0122b-b4e2-4f3c-bbc2-8a263c601a8b', '01a75bac-3b14-4b6d-9ea5-4aa9628e64bb', 'f80f7bf6-44ef-4861-848d-fa52a119f0a8'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:23:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-eea98a23-1740-4d4c-95e7-abb82d500168 tempest-AttachVolumeTestJSON-602814825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-eea98a23-1740-4d4c-95e7-abb82d500168 tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-eea98a23-1740-4d4c-95e7-abb82d500168 tempest-AttachVolumeTestJSON-602814825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:23:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-eea98a23-1740-4d4c-95e7-abb82d500168 tempest-AttachVolumeTestJSON-602814825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:23:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-eea98a23-1740-4d4c-95e7-abb82d500168 tempest-AttachVolumeTestJSON-602814825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-eea98a23-1740-4d4c-95e7-abb82d500168 tempest-AttachVolumeTestJSON-602814825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:07 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:23:07 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:07 devstack sudo[101297]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7 1073741824" returned: 0 in 0.982s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:07 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7 Apr 29 17:23:07 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:07 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-eea98a23-1740-4d4c-95e7-abb82d500168 tempest-AttachVolumeTestJSON-602814825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.717s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:07 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-eea98a23-1740-4d4c-95e7-abb82d500168 tempest-AttachVolumeTestJSON-602814825 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:23:07 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-eea98a23-1740-4d4c-95e7-abb82d500168 tempest-AttachVolumeTestJSON-602814825 None] Deleted volume successfully. Apr 29 17:23:07 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-eea98a23-1740-4d4c-95e7-abb82d500168 tempest-AttachVolumeTestJSON-602814825 None] Lock "cinder-c9c2df04-00ab-4a93-964d-af93ef1757d4-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:23:08 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7" returned: 0 in 0.729s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:23:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f587e5ce-ec5c-4fc3-9f96-b352325e72e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab2dc9a-7f7d-47c7-8c30-af6d5ee2d7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:08 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Volume volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7 (d1a7f3b2-73a3-4091-8c86-68c60c57cfb7): created successfully Apr 29 17:23:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab2dc9a-7f7d-47c7-8c30-af6d5ee2d7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Flow 'volume_create_manager' (7552d3d2-714e-4a2e-8733-4e229011c3d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:23:08 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-3cf3298e-a98c-4562-bc29-b86aff1a81d3 tempest-GroupSnapshotsV319Test-545599823 None] Created volume successfully. Apr 29 17:23:08 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] GroupSnapshot 7f2e2843-8e7d-4b50-82a2-0697bca47aef: creating. Apr 29 17:23:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] Group snapshot 7f2e2843-8e7d-4b50-82a2-0697bca47aef: creating. {{(pid=84547) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 17:23:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] Creating offline snapshot 68a2f1ee-c954-4486-b639-db7b907a72c5 of volume d1a7f3b2-73a3-4091-8c86-68c60c57cfb7 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:23:08 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba8240f-8812-430d-ba15-0686fb52fca9]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:23:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:08 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7 Apr 29 17:23:08 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:09 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7" returned: 0 in 0.843s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.68a2f1ee-c954-4486-b639-db7b907a72c5 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:09 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.68a2f1ee-c954-4486-b639-db7b907a72c5 1G Apr 29 17:23:09 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:10 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.68a2f1ee-c954-4486-b639-db7b907a72c5 1G" returned: 0 in 0.928s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.68a2f1ee-c954-4486-b639-db7b907a72c5 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:10 devstack sudo[101329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.68a2f1ee-c954-4486-b639-db7b907a72c5 Apr 29 17:23:10 devstack sudo[101329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:11 devstack sudo[101329]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.68a2f1ee-c954-4486-b639-db7b907a72c5" returned: 0 in 0.768s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:11 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.68a2f1ee-c954-4486-b639-db7b907a72c5 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 17:23:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.68a2f1ee-c954-4486-b639-db7b907a72c5 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:11 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.68a2f1ee-c954-4486-b639-db7b907a72c5 Apr 29 17:23:11 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:12 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.68a2f1ee-c954-4486-b639-db7b907a72c5" returned: 0 in 0.894s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:12 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.info Apr 29 17:23:12 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:13 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.info" returned: 0 in 0.815s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:13 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 17:23:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:13 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.info Apr 29 17:23:13 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:13 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.info" returned: 0 in 0.729s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.095s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:13 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-96f8c525-9f23-4adc-8422-df2943256add tempest-GroupSnapshotsV319Test-545599823 None] group_snapshot 7f2e2843-8e7d-4b50-82a2-0697bca47aef: created successfully Apr 29 17:23:14 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] group_snapshot 7f2e2843-8e7d-4b50-82a2-0697bca47aef: deleting Apr 29 17:23:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] group_snapshot 7f2e2843-8e7d-4b50-82a2-0697bca47aef: deleting {{(pid=84547) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 17:23:14 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] Acquiring lock "cinder-quobyte-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:23:14 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] Lock "cinder-quobyte-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:23:14 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] Acquiring lock "cinder-quobyte-68a2f1ee-c954-4486-b639-db7b907a72c5" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:23:14 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] Lock "cinder-quobyte-68a2f1ee-c954-4486-b639-db7b907a72c5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:23:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] Deleting offline snapshot 68a2f1ee-c954-4486-b639-db7b907a72c5 of volume d1a7f3b2-73a3-4091-8c86-68c60c57cfb7 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:23:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] snapshot_file for this snap is: volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.68a2f1ee-c954-4486-b639-db7b907a72c5 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:23:14 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe7d984-ec2c-45eb-8bc7-98448a409ca5]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:23:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.68a2f1ee-c954-4486-b639-db7b907a72c5 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:14 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.68a2f1ee-c954-4486-b639-db7b907a72c5 Apr 29 17:23:14 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:15 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.68a2f1ee-c954-4486-b639-db7b907a72c5" returned: 0 in 0.931s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[a605c554-25c1-42eb-a0a5-06288785f6b4]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Flow 'volume_create_manager' (d7ec8d4b-86e6-4e77-bde0-cbb58234f1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac5ef12-c059-4d9d-9fb4-b1685679c6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac5ef12-c059-4d9d-9fb4-b1685679c6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-775604822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230152d01a90428689e7ad853468358c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:23:16Z,use_quota=True,user_id='c5b8845014094fc881fca75dfdf94bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:15 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7 Apr 29 17:23:15 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a1b630-f708-49a6-b8af-09bdad7f418a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87a1b630-f708-49a6-b8af-09bdad7f418a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45498b77-7848-4135-8480-d14038b03896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45498b77-7848-4135-8480-d14038b03896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779', 'volume_name': 'volume-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6c8e76-a6e1-409f-a35a-1bc97d50728c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6c8e76-a6e1-409f-a35a-1bc97d50728c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d760519-63f3-4721-a3d2-504dc0b74c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:15 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Volume 7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779', 'volume_size': 1} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-775604822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230152d01a90428689e7ad853468358c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:23:16Z,use_quota=True,user_id='c5b8845014094fc881fca75dfdf94bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Creating volume 7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:23:15 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:23:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:15 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779 1073741824 Apr 29 17:23:15 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:16 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:23:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Flow 'volume_create_manager' (d1da8156-509b-4793-8729-dfc50a3edcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:23:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aafc89ac-b31b-4e5e-99dd-60c64d9ccb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aafc89ac-b31b-4e5e-99dd-60c64d9ccb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1018345629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9722bc4f-7710-45ad-82c3-93b187dddaac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a83723e3dd624c84a1d239d631dd8ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:23:16Z,use_quota=True,user_id='d0b8dab9ce3f47449105d155fe015afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e493df1-1701-40de-b33d-deb45a968108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e493df1-1701-40de-b33d-deb45a968108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e531eb7-4196-48a9-bdc3-d2f8e4997024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e531eb7-4196-48a9-bdc3-d2f8e4997024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9722bc4f-7710-45ad-82c3-93b187dddaac', 'volume_name': 'volume-9722bc4f-7710-45ad-82c3-93b187dddaac', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed9e981-7514-4ef4-9100-7b474abf513e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed9e981-7514-4ef4-9100-7b474abf513e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8971b665-3172-4e72-92c0-daf08581f90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:16 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Volume 9722bc4f-7710-45ad-82c3-93b187dddaac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9722bc4f-7710-45ad-82c3-93b187dddaac', 'volume_size': 1} Apr 29 17:23:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:16 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7" returned: 0 in 0.907s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.68a2f1ee-c954-4486-b639-db7b907a72c5 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:16 devstack sudo[101362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.68a2f1ee-c954-4486-b639-db7b907a72c5 Apr 29 17:23:16 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:16 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779 1073741824" returned: 0 in 0.959s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:16 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779 Apr 29 17:23:16 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:17 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.68a2f1ee-c954-4486-b639-db7b907a72c5" returned: 0 in 0.817s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.68a2f1ee-c954-4486-b639-db7b907a72c5 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:17 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.68a2f1ee-c954-4486-b639-db7b907a72c5 Apr 29 17:23:17 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:17 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779" returned: 0 in 0.739s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:23:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.363s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1018345629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9722bc4f-7710-45ad-82c3-93b187dddaac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a83723e3dd624c84a1d239d631dd8ded',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:23:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:23:16Z,use_quota=True,user_id='d0b8dab9ce3f47449105d155fe015afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:23:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Creating volume 9722bc4f-7710-45ad-82c3-93b187dddaac {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:23:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:23:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:23:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:23:17 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:23:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9722bc4f-7710-45ad-82c3-93b187dddaac 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d760519-63f3-4721-a3d2-504dc0b74c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:17 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9722bc4f-7710-45ad-82c3-93b187dddaac 1073741824 Apr 29 17:23:17 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73322a09-79d7-4a32-8afc-2ce5030f4807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:17 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Volume volume-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779 (7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779): created successfully Apr 29 17:23:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73322a09-79d7-4a32-8afc-2ce5030f4807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Flow 'volume_create_manager' (d7ec8d4b-86e6-4e77-bde0-cbb58234f1bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:23:17 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4cbca6bf-6e60-487c-9e57-eac8461a5c2c tempest-AttachVolumeShelveTestJSON-737584018 None] Created volume successfully. Apr 29 17:23:18 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7.68a2f1ee-c954-4486-b639-db7b907a72c5" returned: 0 in 0.829s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:18 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] Lock "cinder-quobyte-68a2f1ee-c954-4486-b639-db7b907a72c5" released by "_delete_snapshot" :: held 3.651s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:23:18 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] Lock "cinder-quobyte-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7" released by "delete_snapshot" :: held 3.680s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:23:18 devstack cinder-volume[84547]: WARNING cinder.quota [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-533634296 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-533634296, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:23:18 devstack cinder-volume[84547]: WARNING cinder.quota [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-533634296 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-533634296, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:23:18 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] Created reservations ['903f016d-e5a7-4a3d-bfab-5c898524e2c1', '486c4002-c09c-4f6c-a0ce-12f6c657116b', 'ce2411c0-c6fc-44f5-a17b-5c805a77ff00', 'a09d8329-e9e7-451b-aa89-4cb2c92ada61'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:23:18 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-2864aef3-4727-4db3-957a-e9c01e8398fc tempest-GroupSnapshotsV319Test-545599823 None] group_snapshot 7f2e2843-8e7d-4b50-82a2-0697bca47aef: deleted successfully Apr 29 17:23:18 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9722bc4f-7710-45ad-82c3-93b187dddaac 1073741824" returned: 0 in 1.050s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9722bc4f-7710-45ad-82c3-93b187dddaac {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:18 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9722bc4f-7710-45ad-82c3-93b187dddaac Apr 29 17:23:18 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ceedae43-4abd-4dd6-9d19-6aee962e9b9e tempest-GroupSnapshotsV319Test-545599823 None] Acquiring lock "cinder-quobyte-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:23:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ceedae43-4abd-4dd6-9d19-6aee962e9b9e tempest-GroupSnapshotsV319Test-545599823 None] Lock "cinder-quobyte-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7" acquired by "delete_volume" :: waited 0.021s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:23:19 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[118dbc4b-e770-4009-aa18-6ce3b27cbb0b]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:23:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ceedae43-4abd-4dd6-9d19-6aee962e9b9e tempest-GroupSnapshotsV319Test-545599823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:19 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9722bc4f-7710-45ad-82c3-93b187dddaac" returned: 0 in 0.779s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:23:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8971b665-3172-4e72-92c0-daf08581f90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9722bc4f-7710-45ad-82c3-93b187dddaac', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872779ad-3e75-46bc-b579-bfb60e9bb9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:19 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7 Apr 29 17:23:19 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:19 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Volume volume-9722bc4f-7710-45ad-82c3-93b187dddaac (9722bc4f-7710-45ad-82c3-93b187dddaac): created successfully Apr 29 17:23:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872779ad-3e75-46bc-b579-bfb60e9bb9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Flow 'volume_create_manager' (d1da8156-509b-4793-8729-dfc50a3edcb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:23:19 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-82f91dd5-f95c-4650-ae4f-a8a35b156d0d req-262cf7eb-a27a-4e8a-928f-20902db2fd8c tempest-VolumesGetTestJSON-2066682688 None] Created volume successfully. Apr 29 17:23:20 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ceedae43-4abd-4dd6-9d19-6aee962e9b9e tempest-GroupSnapshotsV319Test-545599823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7" returned: 0 in 0.888s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ceedae43-4abd-4dd6-9d19-6aee962e9b9e tempest-GroupSnapshotsV319Test-545599823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:20 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7 Apr 29 17:23:20 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-445da9e2-2277-469d-9df4-c82447b814e7 req-47d2681a-cccd-4c36-bb8b-a4ea12efde63 tempest-VolumesGetTestJSON-2066682688 None] Acquiring lock "cinder-9722bc4f-7710-45ad-82c3-93b187dddaac-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:23:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-445da9e2-2277-469d-9df4-c82447b814e7 req-47d2681a-cccd-4c36-bb8b-a4ea12efde63 tempest-VolumesGetTestJSON-2066682688 None] Lock "cinder-9722bc4f-7710-45ad-82c3-93b187dddaac-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:23:21 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ceedae43-4abd-4dd6-9d19-6aee962e9b9e tempest-GroupSnapshotsV319Test-545599823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7" returned: 0 in 1.013s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ceedae43-4abd-4dd6-9d19-6aee962e9b9e tempest-GroupSnapshotsV319Test-545599823 None] Lock "cinder-quobyte-d1a7f3b2-73a3-4091-8c86-68c60c57cfb7" released by "delete_volume" :: held 2.023s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:23:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-445da9e2-2277-469d-9df4-c82447b814e7 req-47d2681a-cccd-4c36-bb8b-a4ea12efde63 tempest-VolumesGetTestJSON-2066682688 None] Acquiring lock "cinder-quobyte-9722bc4f-7710-45ad-82c3-93b187dddaac" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:23:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-445da9e2-2277-469d-9df4-c82447b814e7 req-47d2681a-cccd-4c36-bb8b-a4ea12efde63 tempest-VolumesGetTestJSON-2066682688 None] Lock "cinder-quobyte-9722bc4f-7710-45ad-82c3-93b187dddaac" acquired by "delete_volume" :: waited 0.020s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:23:21 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40cf451-9299-4ab2-b762-23c6dc1296bb]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:23:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-445da9e2-2277-469d-9df4-c82447b814e7 req-47d2681a-cccd-4c36-bb8b-a4ea12efde63 tempest-VolumesGetTestJSON-2066682688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9722bc4f-7710-45ad-82c3-93b187dddaac {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:21 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-ceedae43-4abd-4dd6-9d19-6aee962e9b9e tempest-GroupSnapshotsV319Test-545599823 None] Created reservations ['5a5abbd5-adfe-4956-ab29-940c04ca1103'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:23:21 devstack cinder-volume[84547]: WARNING cinder.quota [None req-ceedae43-4abd-4dd6-9d19-6aee962e9b9e tempest-GroupSnapshotsV319Test-545599823 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-533634296 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-533634296, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:23:21 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-ceedae43-4abd-4dd6-9d19-6aee962e9b9e tempest-GroupSnapshotsV319Test-545599823 None] Created reservations ['528ec064-653c-4b4d-b129-e7814372b2c0', 'b063e2dd-8679-47d1-bd0a-d3a3ffa298f2', '01e919e3-2aed-495f-b630-d5f34f47d3f4', '4936cdd8-6816-4c35-ad38-951a8f58be61'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:23:21 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9722bc4f-7710-45ad-82c3-93b187dddaac Apr 29 17:23:21 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ceedae43-4abd-4dd6-9d19-6aee962e9b9e tempest-GroupSnapshotsV319Test-545599823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ceedae43-4abd-4dd6-9d19-6aee962e9b9e tempest-GroupSnapshotsV319Test-545599823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ceedae43-4abd-4dd6-9d19-6aee962e9b9e tempest-GroupSnapshotsV319Test-545599823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:23:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ceedae43-4abd-4dd6-9d19-6aee962e9b9e tempest-GroupSnapshotsV319Test-545599823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:23:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ceedae43-4abd-4dd6-9d19-6aee962e9b9e tempest-GroupSnapshotsV319Test-545599823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ceedae43-4abd-4dd6-9d19-6aee962e9b9e tempest-GroupSnapshotsV319Test-545599823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:21 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:23:21 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:22 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-445da9e2-2277-469d-9df4-c82447b814e7 req-47d2681a-cccd-4c36-bb8b-a4ea12efde63 tempest-VolumesGetTestJSON-2066682688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9722bc4f-7710-45ad-82c3-93b187dddaac" returned: 0 in 0.941s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-445da9e2-2277-469d-9df4-c82447b814e7 req-47d2681a-cccd-4c36-bb8b-a4ea12efde63 tempest-VolumesGetTestJSON-2066682688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9722bc4f-7710-45ad-82c3-93b187dddaac {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:22 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9722bc4f-7710-45ad-82c3-93b187dddaac Apr 29 17:23:22 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:22 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ceedae43-4abd-4dd6-9d19-6aee962e9b9e tempest-GroupSnapshotsV319Test-545599823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.781s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:22 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-ceedae43-4abd-4dd6-9d19-6aee962e9b9e tempest-GroupSnapshotsV319Test-545599823 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:23:22 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ceedae43-4abd-4dd6-9d19-6aee962e9b9e tempest-GroupSnapshotsV319Test-545599823 None] Delete group completed successfully. Apr 29 17:23:23 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-445da9e2-2277-469d-9df4-c82447b814e7 req-47d2681a-cccd-4c36-bb8b-a4ea12efde63 tempest-VolumesGetTestJSON-2066682688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9722bc4f-7710-45ad-82c3-93b187dddaac" returned: 0 in 0.730s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-445da9e2-2277-469d-9df4-c82447b814e7 req-47d2681a-cccd-4c36-bb8b-a4ea12efde63 tempest-VolumesGetTestJSON-2066682688 None] Lock "cinder-quobyte-9722bc4f-7710-45ad-82c3-93b187dddaac" released by "delete_volume" :: held 1.728s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:23:23 devstack cinder-volume[84547]: DEBUG cinder.quota [req-445da9e2-2277-469d-9df4-c82447b814e7 req-47d2681a-cccd-4c36-bb8b-a4ea12efde63 tempest-VolumesGetTestJSON-2066682688 None] Created reservations ['360f85f7-0af5-417e-88f1-332a8c1d7952', 'd69461e4-e112-4266-87f5-cd62b9e8dac3', 'dce919a2-30c8-4c19-96ed-2f104a500285', '264a29f0-8b4c-4970-a932-ade550aaae6a'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:23:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-445da9e2-2277-469d-9df4-c82447b814e7 req-47d2681a-cccd-4c36-bb8b-a4ea12efde63 tempest-VolumesGetTestJSON-2066682688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-445da9e2-2277-469d-9df4-c82447b814e7 req-47d2681a-cccd-4c36-bb8b-a4ea12efde63 tempest-VolumesGetTestJSON-2066682688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:23 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-445da9e2-2277-469d-9df4-c82447b814e7 req-47d2681a-cccd-4c36-bb8b-a4ea12efde63 tempest-VolumesGetTestJSON-2066682688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:23:23 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-445da9e2-2277-469d-9df4-c82447b814e7 req-47d2681a-cccd-4c36-bb8b-a4ea12efde63 tempest-VolumesGetTestJSON-2066682688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:23:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-445da9e2-2277-469d-9df4-c82447b814e7 req-47d2681a-cccd-4c36-bb8b-a4ea12efde63 tempest-VolumesGetTestJSON-2066682688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-445da9e2-2277-469d-9df4-c82447b814e7 req-47d2681a-cccd-4c36-bb8b-a4ea12efde63 tempest-VolumesGetTestJSON-2066682688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:23 devstack sudo[101456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:23:23 devstack sudo[101456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:24 devstack sudo[101456]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-445da9e2-2277-469d-9df4-c82447b814e7 req-47d2681a-cccd-4c36-bb8b-a4ea12efde63 tempest-VolumesGetTestJSON-2066682688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.928s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:24 devstack cinder-volume[84547]: DEBUG cinder.manager [req-445da9e2-2277-469d-9df4-c82447b814e7 req-47d2681a-cccd-4c36-bb8b-a4ea12efde63 tempest-VolumesGetTestJSON-2066682688 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:23:24 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-445da9e2-2277-469d-9df4-c82447b814e7 req-47d2681a-cccd-4c36-bb8b-a4ea12efde63 tempest-VolumesGetTestJSON-2066682688 None] Deleted volume successfully. Apr 29 17:23:24 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-445da9e2-2277-469d-9df4-c82447b814e7 req-47d2681a-cccd-4c36-bb8b-a4ea12efde63 tempest-VolumesGetTestJSON-2066682688 None] Lock "cinder-9722bc4f-7710-45ad-82c3-93b187dddaac-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:23:33 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=83,cinder:INSERT=25,cinder:UPDATE=86,cinder:DELETE=6 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:23:34 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=70,cinder:INSERT=22,cinder:UPDATE=98,cinder:DELETE=3 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:23:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-234bc41e-2a6b-4a5a-9416-b5089266024f req-dbcbac25-7133-4304-a7ae-6f7c95b956ff tempest-AttachVolumeShelveTestJSON-737584018 None] No connector for attachment 2f03755c-9219-42db-8cf1-f95ddb39c3fb; skipping storage backend terminate_connection call. {{(pid=84547) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Apr 29 17:23:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-234bc41e-2a6b-4a5a-9416-b5089266024f req-dbcbac25-7133-4304-a7ae-6f7c95b956ff tempest-AttachVolumeShelveTestJSON-737584018 None] Deleting attachment 2f03755c-9219-42db-8cf1-f95ddb39c3fb. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:23:37 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-35f0114e-007e-4f1f-a549-cdd8689c0b19 tempest-GroupsV320Test-1019173036 None] Group tempest-GroupsV320Test-Group-1289664398: creating Apr 29 17:23:37 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-35f0114e-007e-4f1f-a549-cdd8689c0b19 tempest-GroupsV320Test-1019173036 None] Group tempest-GroupsV320Test-Group-1289664398: created successfully Apr 29 17:23:37 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-35f0114e-007e-4f1f-a549-cdd8689c0b19 tempest-GroupsV320Test-1019173036 None] Create group completed successfully. Apr 29 17:23:39 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-687fffa6-b29a-4e27-a398-8197aa903154 tempest-GroupsV320Test-1019173036 None] Created reservations ['a3144d82-4db0-42a5-8ab2-77d08b813d05'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:23:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-687fffa6-b29a-4e27-a398-8197aa903154 tempest-GroupsV320Test-1019173036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-687fffa6-b29a-4e27-a398-8197aa903154 tempest-GroupsV320Test-1019173036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-687fffa6-b29a-4e27-a398-8197aa903154 tempest-GroupsV320Test-1019173036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:23:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-687fffa6-b29a-4e27-a398-8197aa903154 tempest-GroupsV320Test-1019173036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:23:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-687fffa6-b29a-4e27-a398-8197aa903154 tempest-GroupsV320Test-1019173036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-687fffa6-b29a-4e27-a398-8197aa903154 tempest-GroupsV320Test-1019173036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:39 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:23:39 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:39 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-687fffa6-b29a-4e27-a398-8197aa903154 tempest-GroupsV320Test-1019173036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.715s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:39 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-687fffa6-b29a-4e27-a398-8197aa903154 tempest-GroupsV320Test-1019173036 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:23:39 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-687fffa6-b29a-4e27-a398-8197aa903154 tempest-GroupsV320Test-1019173036 None] Delete group completed successfully. Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Flow 'volume_create_manager' (8c3b15c8-613a-480a-9077-cbcdace05e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c251842-8757-43f7-8e20-e207efab89a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c251842-8757-43f7-8e20-e207efab89a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1151539458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e7e01e6-de6d-44bb-9ee4-4bd68a962265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0289379f933b4067ba5e20d3f66e5185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:23:42Z,use_quota=True,user_id='64da6d500fff483298ebacacd1da62fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2426e7a2-2486-4f54-8a2e-7cc037aad5d0),volume_type_id=2426e7a2-2486-4f54-8a2e-7cc037aad5d0)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47dcef8e-7ac8-43b7-8eda-2aec5d7088bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47dcef8e-7ac8-43b7-8eda-2aec5d7088bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073aa214-9934-4a91-8011-a7662c4cf666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073aa214-9934-4a91-8011-a7662c4cf666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e7e01e6-de6d-44bb-9ee4-4bd68a962265', 'volume_name': 'volume-8e7e01e6-de6d-44bb-9ee4-4bd68a962265', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84197fb1-fa72-4926-9b5b-e0e723321137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84197fb1-fa72-4926-9b5b-e0e723321137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab8104e-2fff-4e10-b4d7-fe7d3e5a68ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:41 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Volume 8e7e01e6-de6d-44bb-9ee4-4bd68a962265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e7e01e6-de6d-44bb-9ee4-4bd68a962265', 'volume_size': 1} Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1151539458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e7e01e6-de6d-44bb-9ee4-4bd68a962265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0289379f933b4067ba5e20d3f66e5185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:23:42Z,use_quota=True,user_id='64da6d500fff483298ebacacd1da62fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2426e7a2-2486-4f54-8a2e-7cc037aad5d0),volume_type_id=2426e7a2-2486-4f54-8a2e-7cc037aad5d0)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Creating volume 8e7e01e6-de6d-44bb-9ee4-4bd68a962265 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:23:41 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:23:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8e7e01e6-de6d-44bb-9ee4-4bd68a962265 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:41 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8e7e01e6-de6d-44bb-9ee4-4bd68a962265 1073741824 Apr 29 17:23:41 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:42 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:23:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Flow 'volume_create_manager' (c01237be-4b2c-439c-a207-f10ed53012d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:23:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4153a4b-481d-4ce9-a915-6cb6b0fd3c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4153a4b-481d-4ce9-a915-6cb6b0fd3c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-253544772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=024393cb-6b74-4858-ba4f-24821e62897d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0289379f933b4067ba5e20d3f66e5185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:23:42Z,use_quota=True,user_id='64da6d500fff483298ebacacd1da62fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b26258-a3c9-4563-9351-113d7818d330),volume_type_id=89b26258-a3c9-4563-9351-113d7818d330)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8461e54a-02f9-43ef-822c-79f43be0011b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8461e54a-02f9-43ef-822c-79f43be0011b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eeaa66b-88ce-41f1-95af-c447716ed8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eeaa66b-88ce-41f1-95af-c447716ed8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '024393cb-6b74-4858-ba4f-24821e62897d', 'volume_name': 'volume-024393cb-6b74-4858-ba4f-24821e62897d', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3060f07a-4e76-4bd4-b37c-8011d8f1f573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3060f07a-4e76-4bd4-b37c-8011d8f1f573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50451a0b-0f26-4661-aa56-16804676dbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:42 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Volume 024393cb-6b74-4858-ba4f-24821e62897d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-024393cb-6b74-4858-ba4f-24821e62897d', 'volume_size': 1} Apr 29 17:23:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:43 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8e7e01e6-de6d-44bb-9ee4-4bd68a962265 1073741824" returned: 0 in 1.262s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8e7e01e6-de6d-44bb-9ee4-4bd68a962265 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:43 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8e7e01e6-de6d-44bb-9ee4-4bd68a962265 Apr 29 17:23:43 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:43 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:23:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Flow 'volume_create_manager' (66535efe-a881-4d76-ad2a-1fd3c9f71ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:23:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a28c475-0bea-4be5-9d8d-96cc7a14fa62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a28c475-0bea-4be5-9d8d-96cc7a14fa62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1036145938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6abc3a8-516b-45a0-a1e6-0e04b810ea0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0289379f933b4067ba5e20d3f66e5185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:23:43Z,use_quota=True,user_id='64da6d500fff483298ebacacd1da62fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfa2923b-3f87-4d0f-8728-dd7a1b2b40a7),volume_type_id=bfa2923b-3f87-4d0f-8728-dd7a1b2b40a7)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d8a27b-defa-4fe3-a6b1-7f9950ea0c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d8a27b-defa-4fe3-a6b1-7f9950ea0c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9165798b-340c-4dba-ab0c-2b2655dbd424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:43 devstack cinder-volume[84547]: DEBUG cinder.image.glance [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Creating Keystone auth plugin from conf {{(pid=84547) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 17:23:44 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8e7e01e6-de6d-44bb-9ee4-4bd68a962265" returned: 0 in 0.896s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] <== create_volume: return (2238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.243s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.637s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-253544772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=024393cb-6b74-4858-ba4f-24821e62897d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0289379f933b4067ba5e20d3f66e5185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:23:42Z,use_quota=True,user_id='64da6d500fff483298ebacacd1da62fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89b26258-a3c9-4563-9351-113d7818d330),volume_type_id=89b26258-a3c9-4563-9351-113d7818d330)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Creating volume 024393cb-6b74-4858-ba4f-24821e62897d {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:23:44 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-024393cb-6b74-4858-ba4f-24821e62897d 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:44 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-024393cb-6b74-4858-ba4f-24821e62897d 1073741824 Apr 29 17:23:44 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab8104e-2fff-4e10-b4d7-fe7d3e5a68ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e7e01e6-de6d-44bb-9ee4-4bd68a962265', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca9c214b-14da-4bb8-8261-2fddcd2d30ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:44 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Volume volume-8e7e01e6-de6d-44bb-9ee4-4bd68a962265 (8e7e01e6-de6d-44bb-9ee4-4bd68a962265): created successfully Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca9c214b-14da-4bb8-8261-2fddcd2d30ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Flow 'volume_create_manager' (8c3b15c8-613a-480a-9077-cbcdace05e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:23:44 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d89b4408-0ce2-4502-9b0b-7bd9e06cdc7d tempest-TestInstancesWithCinderVolumes-804517949 None] Created volume successfully. Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9165798b-340c-4dba-ab0c-2b2655dbd424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a6abc3a8-516b-45a0-a1e6-0e04b810ea0c', 'volume_name': 'volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c', 'volume_size': 1, 'image_id': '427c9e24-2312-47a7-abaf-11243c06a065', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/427c9e24-2312-47a7-abaf-11243c06a065', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--847127671', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0289379f933b4067ba5e20d3f66e5185', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '427c9e24-2312-47a7-abaf-11243c06a065', 'created_at': datetime.datetime(2026, 4, 29, 15, 23, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 23, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/427c9e24-2312-47a7-abaf-11243c06a065/file', 'properties': {}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1a18fa-b7b4-4e22-aede-1ef811af6980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef1a18fa-b7b4-4e22-aede-1ef811af6980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5157a49-dfcc-4a5f-9378-2f8690f9814e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:44 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Volume a6abc3a8-516b-45a0-a1e6-0e04b810ea0c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c', 'volume_size': 1, 'image_id': '427c9e24-2312-47a7-abaf-11243c06a065', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/427c9e24-2312-47a7-abaf-11243c06a065', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--847127671', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0289379f933b4067ba5e20d3f66e5185', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '427c9e24-2312-47a7-abaf-11243c06a065', 'created_at': datetime.datetime(2026, 4, 29, 15, 23, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 23, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/427c9e24-2312-47a7-abaf-11243c06a065/file', 'properties': {}}, 'image_service': } Apr 29 17:23:44 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Trying to clone a6abc3a8-516b-45a0-a1e6-0e04b810ea0c from image 427c9e24-2312-47a7-abaf-11243c06a065 at location (None, [{'url': 'file:///opt/stack/data/glance/images/427c9e24-2312-47a7-abaf-11243c06a065', 'metadata': {}}]). {{(pid=84547) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 17:23:45 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-024393cb-6b74-4858-ba4f-24821e62897d 1073741824" returned: 0 in 1.303s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-024393cb-6b74-4858-ba4f-24821e62897d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:45 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-024393cb-6b74-4858-ba4f-24821e62897d Apr 29 17:23:45 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:46 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-024393cb-6b74-4858-ba4f-24821e62897d" returned: 0 in 1.052s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] <== create_volume: return (2428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.435s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50451a0b-0f26-4661-aa56-16804676dbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-024393cb-6b74-4858-ba4f-24821e62897d', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20dc6aa8-6189-4f87-972a-066bdf7ebb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:46 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Volume volume-024393cb-6b74-4858-ba4f-24821e62897d (024393cb-6b74-4858-ba4f-24821e62897d): created successfully Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20dc6aa8-6189-4f87-972a-066bdf7ebb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Flow 'volume_create_manager' (c01237be-4b2c-439c-a207-f10ed53012d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:23:46 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-7a59f348-b568-4c4a-9602-0e1a304147fb tempest-TestInstancesWithCinderVolumes-804517949 None] Created volume successfully. Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Flow 'volume_create_manager' (d0f14b88-1680-459c-b916-7835079ae98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68664470-cfac-4409-8940-27ed8816243a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68664470-cfac-4409-8940-27ed8816243a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1805858756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b667df-994b-4182-8c0d-c29519bdd2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60c358607bb4eaf943757ba78099572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:23:47Z,use_quota=True,user_id='18caef10089f45a4879fe44322fd7606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63450f66-3621-45b9-91ce-93609c8ddad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63450f66-3621-45b9-91ce-93609c8ddad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d091c0-99c3-45b8-a12c-3f6d34936e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d091c0-99c3-45b8-a12c-3f6d34936e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66b667df-994b-4182-8c0d-c29519bdd2f1', 'volume_name': 'volume-66b667df-994b-4182-8c0d-c29519bdd2f1', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c3eb9c-a0a1-4f8e-9ce8-2261180e1761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30c3eb9c-a0a1-4f8e-9ce8-2261180e1761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969e7a16-950c-4a56-810f-c098c32b404d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:46 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Volume 66b667df-994b-4182-8c0d-c29519bdd2f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66b667df-994b-4182-8c0d-c29519bdd2f1', 'volume_size': 1} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1805858756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66b667df-994b-4182-8c0d-c29519bdd2f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60c358607bb4eaf943757ba78099572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:23:47Z,use_quota=True,user_id='18caef10089f45a4879fe44322fd7606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Creating volume 66b667df-994b-4182-8c0d-c29519bdd2f1 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:23:46 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:23:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-66b667df-994b-4182-8c0d-c29519bdd2f1 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:46 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-66b667df-994b-4182-8c0d-c29519bdd2f1 1073741824 Apr 29 17:23:46 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:48 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-66b667df-994b-4182-8c0d-c29519bdd2f1 1073741824" returned: 0 in 1.105s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-66b667df-994b-4182-8c0d-c29519bdd2f1 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:48 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-66b667df-994b-4182-8c0d-c29519bdd2f1 Apr 29 17:23:48 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:48 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:23:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Flow 'volume_create_manager' (7d60ba89-1bbf-4e9f-91c5-5c9337b9ec78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:23:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d277a11a-0a47-406e-b77c-d35c1880e7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d277a11a-0a47-406e-b77c-d35c1880e7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-63979398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5e01108-94d6-47f7-b85f-229cf7a7da03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fe1eaddcc543a49ee0e2cde9b460b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:23:49Z,use_quota=True,user_id='ea4e3b71c5514a5caf501256d294b107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc15ef9-884c-4100-b7dc-54fa6277805d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc15ef9-884c-4100-b7dc-54fa6277805d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c128c09-2903-42d4-9ee2-9589316a653a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c128c09-2903-42d4-9ee2-9589316a653a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5e01108-94d6-47f7-b85f-229cf7a7da03', 'volume_name': 'volume-e5e01108-94d6-47f7-b85f-229cf7a7da03', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12565ce-29a0-42c5-b7b1-d80e79593abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12565ce-29a0-42c5-b7b1-d80e79593abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8995204-88aa-4c80-b5e0-7db538187ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:48 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Volume e5e01108-94d6-47f7-b85f-229cf7a7da03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5e01108-94d6-47f7-b85f-229cf7a7da03', 'volume_size': 1} Apr 29 17:23:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:48 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-66b667df-994b-4182-8c0d-c29519bdd2f1" returned: 0 in 0.887s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:49 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:23:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.159s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:49 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-63979398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5e01108-94d6-47f7-b85f-229cf7a7da03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fe1eaddcc543a49ee0e2cde9b460b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:23:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:23:49Z,use_quota=True,user_id='ea4e3b71c5514a5caf501256d294b107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:23:49 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Creating volume e5e01108-94d6-47f7-b85f-229cf7a7da03 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:23:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:49 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:23:49 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:23:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:49 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:23:49 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:23:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e5e01108-94d6-47f7-b85f-229cf7a7da03 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:49 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969e7a16-950c-4a56-810f-c098c32b404d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66b667df-994b-4182-8c0d-c29519bdd2f1', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:49 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e5e01108-94d6-47f7-b85f-229cf7a7da03 1073741824 Apr 29 17:23:49 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:49 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9bd7f0b-c46f-4396-ad6a-d2aa7e732620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:49 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Volume volume-66b667df-994b-4182-8c0d-c29519bdd2f1 (66b667df-994b-4182-8c0d-c29519bdd2f1): created successfully Apr 29 17:23:49 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9bd7f0b-c46f-4396-ad6a-d2aa7e732620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:49 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Flow 'volume_create_manager' (d0f14b88-1680-459c-b916-7835079ae98a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:23:49 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-26296f4e-b85b-4bf9-9c87-fee49acbd2c6 tempest-VolumeQuotasNegativeTestJSON-213943708 None] Created volume successfully. Apr 29 17:23:49 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_427c9e24-2312-47a7-abaf-11243c06a065_y00tf68cdevstack@QuobyteHD, size 20.69 MB, duration 5.21 sec {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 17:23:49 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Image download 20.69 MB at 3.97 MB/s Apr 29 17:23:49 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[99341e26-df4a-47d7-b1e0-63114cc649bf]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:23:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_427c9e24-2312-47a7-abaf-11243c06a065_y00tf68cdevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:49 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_427c9e24-2312-47a7-abaf-11243c06a065_y00tf68cdevstack@QuobyteHD Apr 29 17:23:49 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:50 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e5e01108-94d6-47f7-b85f-229cf7a7da03 1073741824" returned: 0 in 1.047s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e5e01108-94d6-47f7-b85f-229cf7a7da03 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:50 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e5e01108-94d6-47f7-b85f-229cf7a7da03 Apr 29 17:23:50 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:50 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_427c9e24-2312-47a7-abaf-11243c06a065_y00tf68cdevstack@QuobyteHD" returned: 0 in 0.952s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:50 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Temporary image 427c9e24-2312-47a7-abaf-11243c06a065 is fetched for user 64da6d500fff483298ebacacd1da62fd. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 17:23:50 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2669ec5-f6f8-4763-955e-8abd6c088793]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:23:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_427c9e24-2312-47a7-abaf-11243c06a065_y00tf68cdevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:50 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_427c9e24-2312-47a7-abaf-11243c06a065_y00tf68cdevstack@QuobyteHD Apr 29 17:23:50 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:50 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e5e01108-94d6-47f7-b85f-229cf7a7da03" returned: 0 in 0.766s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:23:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8995204-88aa-4c80-b5e0-7db538187ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5e01108-94d6-47f7-b85f-229cf7a7da03', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d80800b-460e-4949-b96f-17284e0c5b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:50 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Volume volume-e5e01108-94d6-47f7-b85f-229cf7a7da03 (e5e01108-94d6-47f7-b85f-229cf7a7da03): created successfully Apr 29 17:23:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d80800b-460e-4949-b96f-17284e0c5b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Flow 'volume_create_manager' (7d60ba89-1bbf-4e9f-91c5-5c9337b9ec78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:23:51 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-a7f6ab2e-4bb3-4ab7-8b99-01ec4cf4fe71 tempest-VolumeQuotasAdminTestJSON-860327399 None] Created volume successfully. Apr 29 17:23:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-630b9e38-1fcd-4129-ad71-86eafbb2e9cc tempest-VolumeQuotasNegativeTestJSON-213943708 None] Acquiring lock "cinder-66b667df-994b-4182-8c0d-c29519bdd2f1-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:23:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-630b9e38-1fcd-4129-ad71-86eafbb2e9cc tempest-VolumeQuotasNegativeTestJSON-213943708 None] Lock "cinder-66b667df-994b-4182-8c0d-c29519bdd2f1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:23:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-630b9e38-1fcd-4129-ad71-86eafbb2e9cc tempest-VolumeQuotasNegativeTestJSON-213943708 None] Acquiring lock "cinder-quobyte-66b667df-994b-4182-8c0d-c29519bdd2f1" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:23:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-630b9e38-1fcd-4129-ad71-86eafbb2e9cc tempest-VolumeQuotasNegativeTestJSON-213943708 None] Lock "cinder-quobyte-66b667df-994b-4182-8c0d-c29519bdd2f1" acquired by "delete_volume" :: waited 0.014s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:23:51 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d002914-30f4-4bb4-a266-f3c623d4eff8]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:23:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-630b9e38-1fcd-4129-ad71-86eafbb2e9cc tempest-VolumeQuotasNegativeTestJSON-213943708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-66b667df-994b-4182-8c0d-c29519bdd2f1 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:51 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_427c9e24-2312-47a7-abaf-11243c06a065_y00tf68cdevstack@QuobyteHD" returned: 0 in 0.853s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1036145938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6abc3a8-516b-45a0-a1e6-0e04b810ea0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0289379f933b4067ba5e20d3f66e5185',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:23:43Z,use_quota=True,user_id='64da6d500fff483298ebacacd1da62fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfa2923b-3f87-4d0f-8728-dd7a1b2b40a7),volume_type_id=bfa2923b-3f87-4d0f-8728-dd7a1b2b40a7)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:23:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Creating volume a6abc3a8-516b-45a0-a1e6-0e04b810ea0c {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:23:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:23:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:23:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:23:51 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:23:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:51 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-66b667df-994b-4182-8c0d-c29519bdd2f1 Apr 29 17:23:51 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:51 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c 1073741824 Apr 29 17:23:51 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-fda1c1a4-67ea-4b9e-be87-e60ba5508564 tempest-VolumeQuotasAdminTestJSON-860327399 None] Acquiring lock "cinder-e5e01108-94d6-47f7-b85f-229cf7a7da03-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:23:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-fda1c1a4-67ea-4b9e-be87-e60ba5508564 tempest-VolumeQuotasAdminTestJSON-860327399 None] Lock "cinder-e5e01108-94d6-47f7-b85f-229cf7a7da03-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:23:52 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-630b9e38-1fcd-4129-ad71-86eafbb2e9cc tempest-VolumeQuotasNegativeTestJSON-213943708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-66b667df-994b-4182-8c0d-c29519bdd2f1" returned: 0 in 0.767s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-630b9e38-1fcd-4129-ad71-86eafbb2e9cc tempest-VolumeQuotasNegativeTestJSON-213943708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-66b667df-994b-4182-8c0d-c29519bdd2f1 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:52 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-66b667df-994b-4182-8c0d-c29519bdd2f1 Apr 29 17:23:52 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-fda1c1a4-67ea-4b9e-be87-e60ba5508564 tempest-VolumeQuotasAdminTestJSON-860327399 None] Acquiring lock "cinder-quobyte-e5e01108-94d6-47f7-b85f-229cf7a7da03" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:23:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-fda1c1a4-67ea-4b9e-be87-e60ba5508564 tempest-VolumeQuotasAdminTestJSON-860327399 None] Lock "cinder-quobyte-e5e01108-94d6-47f7-b85f-229cf7a7da03" acquired by "delete_volume" :: waited 0.030s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:23:52 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b535dc-de0a-47e6-8cbc-71a86a906e3f]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:23:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fda1c1a4-67ea-4b9e-be87-e60ba5508564 tempest-VolumeQuotasAdminTestJSON-860327399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e5e01108-94d6-47f7-b85f-229cf7a7da03 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:52 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e5e01108-94d6-47f7-b85f-229cf7a7da03 Apr 29 17:23:52 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:52 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c 1073741824" returned: 0 in 0.986s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:52 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c Apr 29 17:23:52 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:52 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-630b9e38-1fcd-4129-ad71-86eafbb2e9cc tempest-VolumeQuotasNegativeTestJSON-213943708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-66b667df-994b-4182-8c0d-c29519bdd2f1" returned: 0 in 0.717s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-630b9e38-1fcd-4129-ad71-86eafbb2e9cc tempest-VolumeQuotasNegativeTestJSON-213943708 None] Lock "cinder-quobyte-66b667df-994b-4182-8c0d-c29519bdd2f1" released by "delete_volume" :: held 1.549s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:23:52 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-630b9e38-1fcd-4129-ad71-86eafbb2e9cc tempest-VolumeQuotasNegativeTestJSON-213943708 None] Created reservations ['1fc3b397-00f3-47c6-80df-dd5981c4ec8b', 'fdc63a09-8067-4219-b337-e8d27fee26fa', '9c7d0818-3ab2-4a8a-83c2-e5ad1936d1bb', '87f8cd0c-401b-4973-9767-85e4617dd35b'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:23:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-630b9e38-1fcd-4129-ad71-86eafbb2e9cc tempest-VolumeQuotasNegativeTestJSON-213943708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-630b9e38-1fcd-4129-ad71-86eafbb2e9cc tempest-VolumeQuotasNegativeTestJSON-213943708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-630b9e38-1fcd-4129-ad71-86eafbb2e9cc tempest-VolumeQuotasNegativeTestJSON-213943708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:23:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-630b9e38-1fcd-4129-ad71-86eafbb2e9cc tempest-VolumeQuotasNegativeTestJSON-213943708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:23:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-630b9e38-1fcd-4129-ad71-86eafbb2e9cc tempest-VolumeQuotasNegativeTestJSON-213943708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-630b9e38-1fcd-4129-ad71-86eafbb2e9cc tempest-VolumeQuotasNegativeTestJSON-213943708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:53 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:23:53 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:53 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fda1c1a4-67ea-4b9e-be87-e60ba5508564 tempest-VolumeQuotasAdminTestJSON-860327399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e5e01108-94d6-47f7-b85f-229cf7a7da03" returned: 0 in 0.929s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fda1c1a4-67ea-4b9e-be87-e60ba5508564 tempest-VolumeQuotasAdminTestJSON-860327399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e5e01108-94d6-47f7-b85f-229cf7a7da03 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:53 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e5e01108-94d6-47f7-b85f-229cf7a7da03 Apr 29 17:23:53 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:53 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c" returned: 0 in 0.867s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:23:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:53 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Attempting download of 427c9e24-2312-47a7-abaf-11243c06a065 ((None, [{'url': 'file:///opt/stack/data/glance/images/427c9e24-2312-47a7-abaf-11243c06a065', 'metadata': {}}])) to volume a6abc3a8-516b-45a0-a1e6-0e04b810ea0c. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 17:23:53 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cb9f78-be07-4fbb-9437-6085ef9cc2d2]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:23:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_427c9e24-2312-47a7-abaf-11243c06a065_7t7jxek3 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:53 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_427c9e24-2312-47a7-abaf-11243c06a065_7t7jxek3 Apr 29 17:23:53 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:54 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-630b9e38-1fcd-4129-ad71-86eafbb2e9cc tempest-VolumeQuotasNegativeTestJSON-213943708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.927s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:54 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-630b9e38-1fcd-4129-ad71-86eafbb2e9cc tempest-VolumeQuotasNegativeTestJSON-213943708 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:23:54 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-630b9e38-1fcd-4129-ad71-86eafbb2e9cc tempest-VolumeQuotasNegativeTestJSON-213943708 None] Deleted volume successfully. Apr 29 17:23:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-630b9e38-1fcd-4129-ad71-86eafbb2e9cc tempest-VolumeQuotasNegativeTestJSON-213943708 None] Lock "cinder-66b667df-994b-4182-8c0d-c29519bdd2f1-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:23:54 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fda1c1a4-67ea-4b9e-be87-e60ba5508564 tempest-VolumeQuotasAdminTestJSON-860327399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e5e01108-94d6-47f7-b85f-229cf7a7da03" returned: 0 in 0.989s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-fda1c1a4-67ea-4b9e-be87-e60ba5508564 tempest-VolumeQuotasAdminTestJSON-860327399 None] Lock "cinder-quobyte-e5e01108-94d6-47f7-b85f-229cf7a7da03" released by "delete_volume" :: held 1.984s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:23:54 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-fda1c1a4-67ea-4b9e-be87-e60ba5508564 tempest-VolumeQuotasAdminTestJSON-860327399 None] Created reservations ['ab75f1bd-a6ab-4089-ba75-60fb6a0c60fd', 'a95d2ca5-16c0-424e-a6e4-2238cd0ef5b3', '9685f833-83b8-47c9-b688-f4fb929eed08', 'd62ae869-6ce8-4bdb-a702-dec539a24dec'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:23:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fda1c1a4-67ea-4b9e-be87-e60ba5508564 tempest-VolumeQuotasAdminTestJSON-860327399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fda1c1a4-67ea-4b9e-be87-e60ba5508564 tempest-VolumeQuotasAdminTestJSON-860327399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fda1c1a4-67ea-4b9e-be87-e60ba5508564 tempest-VolumeQuotasAdminTestJSON-860327399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:23:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fda1c1a4-67ea-4b9e-be87-e60ba5508564 tempest-VolumeQuotasAdminTestJSON-860327399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:23:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fda1c1a4-67ea-4b9e-be87-e60ba5508564 tempest-VolumeQuotasAdminTestJSON-860327399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fda1c1a4-67ea-4b9e-be87-e60ba5508564 tempest-VolumeQuotasAdminTestJSON-860327399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:54 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:23:54 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:54 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_427c9e24-2312-47a7-abaf-11243c06a065_7t7jxek3" returned: 0 in 0.985s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_427c9e24-2312-47a7-abaf-11243c06a065_7t7jxek3 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:54 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_427c9e24-2312-47a7-abaf-11243c06a065_7t7jxek3 Apr 29 17:23:54 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:55 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fda1c1a4-67ea-4b9e-be87-e60ba5508564 tempest-VolumeQuotasAdminTestJSON-860327399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.776s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:55 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-fda1c1a4-67ea-4b9e-be87-e60ba5508564 tempest-VolumeQuotasAdminTestJSON-860327399 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:23:55 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-fda1c1a4-67ea-4b9e-be87-e60ba5508564 tempest-VolumeQuotasAdminTestJSON-860327399 None] Deleted volume successfully. Apr 29 17:23:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-fda1c1a4-67ea-4b9e-be87-e60ba5508564 tempest-VolumeQuotasAdminTestJSON-860327399 None] Lock "cinder-e5e01108-94d6-47f7-b85f-229cf7a7da03-delete_volume" released by "delete_volume" :: held 3.138s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:23:55 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_427c9e24-2312-47a7-abaf-11243c06a065_7t7jxek3" returned: 1 in 0.939s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_427c9e24-2312-47a7-abaf-11243c06a065_7t7jxek3' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:23:55 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[512f58c0-bc39-434b-9074-49d488f773ad]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:23:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_427c9e24-2312-47a7-abaf-11243c06a065_y00tf68cdevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:55 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_427c9e24-2312-47a7-abaf-11243c06a065_y00tf68cdevstack@QuobyteHD Apr 29 17:23:55 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Flow 'volume_create_manager' (224b241d-909a-4b27-837e-d37300bd692d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26dafb02-59bb-4860-80c4-d518831bb7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26dafb02-59bb-4860-80c4-d518831bb7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1690162518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39bcda54-f76e-4175-9b62-17d564d75f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fe1eaddcc543a49ee0e2cde9b460b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:23:56Z,use_quota=True,user_id='ea4e3b71c5514a5caf501256d294b107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7824f647-70c2-43ce-adfe-a8382285d3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7824f647-70c2-43ce-adfe-a8382285d3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ff0019-3295-436f-bd3a-ec7aef1ced63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ff0019-3295-436f-bd3a-ec7aef1ced63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39bcda54-f76e-4175-9b62-17d564d75f79', 'volume_name': 'volume-39bcda54-f76e-4175-9b62-17d564d75f79', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b0846a-c064-4bbc-841a-292162cfe9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b0846a-c064-4bbc-841a-292162cfe9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6dc4a3f-dcd5-4993-9264-4cc0608aba08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:56 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Volume 39bcda54-f76e-4175-9b62-17d564d75f79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39bcda54-f76e-4175-9b62-17d564d75f79', 'volume_size': 1} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1690162518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39bcda54-f76e-4175-9b62-17d564d75f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2fe1eaddcc543a49ee0e2cde9b460b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:23:56Z,use_quota=True,user_id='ea4e3b71c5514a5caf501256d294b107',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Creating volume 39bcda54-f76e-4175-9b62-17d564d75f79 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:23:56 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-39bcda54-f76e-4175-9b62-17d564d75f79 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:56 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-39bcda54-f76e-4175-9b62-17d564d75f79 1073741824 Apr 29 17:23:56 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:56 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_427c9e24-2312-47a7-abaf-11243c06a065_y00tf68cdevstack@QuobyteHD" returned: 0 in 0.881s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] 427c9e24-2312-47a7-abaf-11243c06a065 was qcow2, converting to raw {{(pid=84547) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 17:23:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_427c9e24-2312-47a7-abaf-11243c06a065_y00tf68cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:56 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_427c9e24-2312-47a7-abaf-11243c06a065_y00tf68cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c Apr 29 17:23:56 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:57 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-39bcda54-f76e-4175-9b62-17d564d75f79 1073741824" returned: 0 in 1.193s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-39bcda54-f76e-4175-9b62-17d564d75f79 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:57 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-39bcda54-f76e-4175-9b62-17d564d75f79 Apr 29 17:23:57 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:23:58 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-39bcda54-f76e-4175-9b62-17d564d75f79" returned: 0 in 1.322s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:58 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] <== create_volume: return (2606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:23:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.609s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:23:58 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6dc4a3f-dcd5-4993-9264-4cc0608aba08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39bcda54-f76e-4175-9b62-17d564d75f79', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:58 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c84c0b1-edcb-4d46-a32b-df52c5d9a51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:23:58 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Volume volume-39bcda54-f76e-4175-9b62-17d564d75f79 (39bcda54-f76e-4175-9b62-17d564d75f79): created successfully Apr 29 17:23:58 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c84c0b1-edcb-4d46-a32b-df52c5d9a51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:23:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Flow 'volume_create_manager' (224b241d-909a-4b27-837e-d37300bd692d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:23:59 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-efc895b3-280f-44f4-9029-229c2213a1f9 tempest-VolumeQuotasAdminTestJSON-860327399 None] Created volume successfully. Apr 29 17:23:59 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Apr 29 17:23:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_427c9e24-2312-47a7-abaf-11243c06a065_y00tf68cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c" returned: 0 in 3.082s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:23:59 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_427c9e24-2312-47a7-abaf-11243c06a065_y00tf68cdevstack@QuobyteHD, size 112.00 MB, duration 3.08 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:23:59 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Converted 112.00 MB image at 36.33 MB/s Apr 29 17:23:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:23:59 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c 1G Apr 29 17:23:59 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:00 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c 1G" returned: 0 in 1.123s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:00 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[a689e423-04bb-4591-ae02-c475a8bab9a2]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:24:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:00 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-df590ab4-b9ec-4d01-a815-8c39c0285eb6 tempest-VolumeQuotasAdminTestJSON-1002196398 None] Transfer volume completed successfully. Apr 29 17:24:00 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c Apr 29 17:24:00 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:01 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c" returned: 0 in 0.894s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:01 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c Apr 29 17:24:01 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b86ee2e4-852d-4e65-a970-967f2d6b3f36 tempest-VolumeQuotasAdminTestJSON-902272891 None] Acquiring lock "cinder-39bcda54-f76e-4175-9b62-17d564d75f79-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:24:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b86ee2e4-852d-4e65-a970-967f2d6b3f36 tempest-VolumeQuotasAdminTestJSON-902272891 None] Lock "cinder-39bcda54-f76e-4175-9b62-17d564d75f79-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:24:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b86ee2e4-852d-4e65-a970-967f2d6b3f36 tempest-VolumeQuotasAdminTestJSON-902272891 None] Acquiring lock "cinder-quobyte-39bcda54-f76e-4175-9b62-17d564d75f79" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:24:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b86ee2e4-852d-4e65-a970-967f2d6b3f36 tempest-VolumeQuotasAdminTestJSON-902272891 None] Lock "cinder-quobyte-39bcda54-f76e-4175-9b62-17d564d75f79" acquired by "delete_volume" :: waited 0.021s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:24:01 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadc6dbb-c659-4288-a535-1254409eebe4]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:24:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b86ee2e4-852d-4e65-a970-967f2d6b3f36 tempest-VolumeQuotasAdminTestJSON-902272891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-39bcda54-f76e-4175-9b62-17d564d75f79 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:24:02 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-39bcda54-f76e-4175-9b62-17d564d75f79 Apr 29 17:24:02 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Flow 'volume_create_manager' (f1a47dbf-8b9f-4566-94dc-5295ae40bb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef337ae-1940-4130-ac0d-0c00c3c0676a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eef337ae-1940-4130-ac0d-0c00c3c0676a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-335649824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea2e844-0da2-4506-8210-d0287eb12669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1116dc3a658b4eea8334c0e7f88a0328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:24:02Z,use_quota=True,user_id='46fab617385d407a813a0f8a2cba3ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b005900b-8b71-4874-9725-2fed16807fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b005900b-8b71-4874-9725-2fed16807fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61270703-f7f5-4da9-98bb-979a8110afce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61270703-f7f5-4da9-98bb-979a8110afce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cea2e844-0da2-4506-8210-d0287eb12669', 'volume_name': 'volume-cea2e844-0da2-4506-8210-d0287eb12669', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9596ac9-f609-4b72-b27f-1f1554b250a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9596ac9-f609-4b72-b27f-1f1554b250a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e087c26-99dd-4262-be55-1396040901ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:02 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Volume cea2e844-0da2-4506-8210-d0287eb12669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cea2e844-0da2-4506-8210-d0287eb12669', 'volume_size': 1} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-335649824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea2e844-0da2-4506-8210-d0287eb12669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1116dc3a658b4eea8334c0e7f88a0328',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:24:02Z,use_quota=True,user_id='46fab617385d407a813a0f8a2cba3ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Creating volume cea2e844-0da2-4506-8210-d0287eb12669 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:24:02 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cea2e844-0da2-4506-8210-d0287eb12669 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:02 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cea2e844-0da2-4506-8210-d0287eb12669 1073741824 Apr 29 17:24:02 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:02 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c" returned: 1 in 0.965s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Downloaded image 427c9e24-2312-47a7-abaf-11243c06a065 ((None, [{'url': 'file:///opt/stack/data/glance/images/427c9e24-2312-47a7-abaf-11243c06a065', 'metadata': {}}])) to volume a6abc3a8-516b-45a0-a1e6-0e04b810ea0c successfully. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Temporary image 427c9e24-2312-47a7-abaf-11243c06a065 for user 64da6d500fff483298ebacacd1da62fd is deleted. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Marking volume a6abc3a8-516b-45a0-a1e6-0e04b810ea0c as bootable. {{(pid=84547) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Copying metadata from image 427c9e24-2312-47a7-abaf-11243c06a065 to a6abc3a8-516b-45a0-a1e6-0e04b810ea0c. {{(pid=84547) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Creating volume glance metadata for volume a6abc3a8-516b-45a0-a1e6-0e04b810ea0c backed by image 427c9e24-2312-47a7-abaf-11243c06a065 with: {'image_id': '427c9e24-2312-47a7-abaf-11243c06a065', 'image_name': 'tempest-scenario-img--847127671', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84547) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5157a49-dfcc-4a5f-9378-2f8690f9814e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c', 'volume_size': 1, 'image_id': '427c9e24-2312-47a7-abaf-11243c06a065', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/427c9e24-2312-47a7-abaf-11243c06a065', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--847127671', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0289379f933b4067ba5e20d3f66e5185', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '427c9e24-2312-47a7-abaf-11243c06a065', 'created_at': datetime.datetime(2026, 4, 29, 15, 23, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 23, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/427c9e24-2312-47a7-abaf-11243c06a065/file', 'properties': {}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5886374-417f-404a-b862-de6f8739aa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:02 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Volume volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c (a6abc3a8-516b-45a0-a1e6-0e04b810ea0c): created successfully Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5886374-417f-404a-b862-de6f8739aa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Flow 'volume_create_manager' (66535efe-a881-4d76-ad2a-1fd3c9f71ca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:24:02 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ba5e759e-6f29-451b-bb20-4fafaed5ce73 tempest-TestInstancesWithCinderVolumes-804517949 None] Created volume successfully. Apr 29 17:24:02 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b86ee2e4-852d-4e65-a970-967f2d6b3f36 tempest-VolumeQuotasAdminTestJSON-902272891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-39bcda54-f76e-4175-9b62-17d564d75f79" returned: 0 in 0.909s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b86ee2e4-852d-4e65-a970-967f2d6b3f36 tempest-VolumeQuotasAdminTestJSON-902272891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-39bcda54-f76e-4175-9b62-17d564d75f79 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:02 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-39bcda54-f76e-4175-9b62-17d564d75f79 Apr 29 17:24:02 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:03 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cea2e844-0da2-4506-8210-d0287eb12669 1073741824" returned: 0 in 0.885s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cea2e844-0da2-4506-8210-d0287eb12669 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:03 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cea2e844-0da2-4506-8210-d0287eb12669 Apr 29 17:24:03 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:03 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b86ee2e4-852d-4e65-a970-967f2d6b3f36 tempest-VolumeQuotasAdminTestJSON-902272891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-39bcda54-f76e-4175-9b62-17d564d75f79" returned: 0 in 0.700s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b86ee2e4-852d-4e65-a970-967f2d6b3f36 tempest-VolumeQuotasAdminTestJSON-902272891 None] Lock "cinder-quobyte-39bcda54-f76e-4175-9b62-17d564d75f79" released by "delete_volume" :: held 1.662s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:24:03 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-b86ee2e4-852d-4e65-a970-967f2d6b3f36 tempest-VolumeQuotasAdminTestJSON-902272891 None] Created reservations ['6eec8334-7992-40d9-9dec-d250e0183063', '85456462-fd64-44fd-af0c-abcb0cdc4515', '61a1b3b8-0b1e-4522-9f09-30e8977187e9', '525f967a-d72c-4d01-bf30-4bf7e501ede9'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:24:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b86ee2e4-852d-4e65-a970-967f2d6b3f36 tempest-VolumeQuotasAdminTestJSON-902272891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b86ee2e4-852d-4e65-a970-967f2d6b3f36 tempest-VolumeQuotasAdminTestJSON-902272891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b86ee2e4-852d-4e65-a970-967f2d6b3f36 tempest-VolumeQuotasAdminTestJSON-902272891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:24:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b86ee2e4-852d-4e65-a970-967f2d6b3f36 tempest-VolumeQuotasAdminTestJSON-902272891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:24:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b86ee2e4-852d-4e65-a970-967f2d6b3f36 tempest-VolumeQuotasAdminTestJSON-902272891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b86ee2e4-852d-4e65-a970-967f2d6b3f36 tempest-VolumeQuotasAdminTestJSON-902272891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:03 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:24:03 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:04 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cea2e844-0da2-4506-8210-d0287eb12669" returned: 0 in 0.777s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:04 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:24:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:04 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e087c26-99dd-4262-be55-1396040901ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cea2e844-0da2-4506-8210-d0287eb12669', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:04 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc2efaf-c954-44c9-8bc7-edfc9dc8c5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:04 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Volume volume-cea2e844-0da2-4506-8210-d0287eb12669 (cea2e844-0da2-4506-8210-d0287eb12669): created successfully Apr 29 17:24:04 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc2efaf-c954-44c9-8bc7-edfc9dc8c5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:04 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Flow 'volume_create_manager' (f1a47dbf-8b9f-4566-94dc-5295ae40bb98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:24:04 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-74ddc315-08c7-415e-aa68-60651940aa63 tempest-VolumesServicesTestJSON-972764435 None] Created volume successfully. Apr 29 17:24:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1c1cd96b-e5ce-48db-bcfe-09361651e730 tempest-VolumesServicesTestJSON-972764435 None] Acquiring lock "cinder-cea2e844-0da2-4506-8210-d0287eb12669-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:24:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1c1cd96b-e5ce-48db-bcfe-09361651e730 tempest-VolumesServicesTestJSON-972764435 None] Lock "cinder-cea2e844-0da2-4506-8210-d0287eb12669-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:24:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1c1cd96b-e5ce-48db-bcfe-09361651e730 tempest-VolumesServicesTestJSON-972764435 None] Acquiring lock "cinder-quobyte-cea2e844-0da2-4506-8210-d0287eb12669" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:24:04 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1c1cd96b-e5ce-48db-bcfe-09361651e730 tempest-VolumesServicesTestJSON-972764435 None] Lock "cinder-quobyte-cea2e844-0da2-4506-8210-d0287eb12669" acquired by "delete_volume" :: waited 0.027s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:24:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b86ee2e4-852d-4e65-a970-967f2d6b3f36 tempest-VolumeQuotasAdminTestJSON-902272891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.924s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:04 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-b86ee2e4-852d-4e65-a970-967f2d6b3f36 tempest-VolumeQuotasAdminTestJSON-902272891 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:24:04 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-b86ee2e4-852d-4e65-a970-967f2d6b3f36 tempest-VolumeQuotasAdminTestJSON-902272891 None] Deleted volume successfully. Apr 29 17:24:04 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[60485291-3d02-4421-b12d-17509566a224]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:24:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1c1cd96b-e5ce-48db-bcfe-09361651e730 tempest-VolumesServicesTestJSON-972764435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cea2e844-0da2-4506-8210-d0287eb12669 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b86ee2e4-852d-4e65-a970-967f2d6b3f36 tempest-VolumeQuotasAdminTestJSON-902272891 None] Lock "cinder-39bcda54-f76e-4175-9b62-17d564d75f79-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:24:04 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cea2e844-0da2-4506-8210-d0287eb12669 Apr 29 17:24:04 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:24:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:24:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:24:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:05 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:24:05 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:05 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1c1cd96b-e5ce-48db-bcfe-09361651e730 tempest-VolumesServicesTestJSON-972764435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cea2e844-0da2-4506-8210-d0287eb12669" returned: 0 in 1.170s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1c1cd96b-e5ce-48db-bcfe-09361651e730 tempest-VolumesServicesTestJSON-972764435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cea2e844-0da2-4506-8210-d0287eb12669 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:05 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cea2e844-0da2-4506-8210-d0287eb12669 Apr 29 17:24:05 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:06 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.807s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:24:06 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1c1cd96b-e5ce-48db-bcfe-09361651e730 tempest-VolumesServicesTestJSON-972764435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cea2e844-0da2-4506-8210-d0287eb12669" returned: 0 in 0.754s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1c1cd96b-e5ce-48db-bcfe-09361651e730 tempest-VolumesServicesTestJSON-972764435 None] Lock "cinder-quobyte-cea2e844-0da2-4506-8210-d0287eb12669" released by "delete_volume" :: held 2.012s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:24:06 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-1c1cd96b-e5ce-48db-bcfe-09361651e730 tempest-VolumesServicesTestJSON-972764435 None] Created reservations ['7b6b63ce-9124-4885-a736-0750904ce844', 'f0598831-c211-4125-aa75-4e2c0dd89feb', 'd17d9a59-32d8-4a61-a65d-794e9d824496', '11873d84-eab4-4ad9-b617-400fdc08ee8c'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:24:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1c1cd96b-e5ce-48db-bcfe-09361651e730 tempest-VolumesServicesTestJSON-972764435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1c1cd96b-e5ce-48db-bcfe-09361651e730 tempest-VolumesServicesTestJSON-972764435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1c1cd96b-e5ce-48db-bcfe-09361651e730 tempest-VolumesServicesTestJSON-972764435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:24:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1c1cd96b-e5ce-48db-bcfe-09361651e730 tempest-VolumesServicesTestJSON-972764435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:24:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1c1cd96b-e5ce-48db-bcfe-09361651e730 tempest-VolumesServicesTestJSON-972764435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1c1cd96b-e5ce-48db-bcfe-09361651e730 tempest-VolumesServicesTestJSON-972764435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:07 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:24:07 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:08 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1c1cd96b-e5ce-48db-bcfe-09361651e730 tempest-VolumesServicesTestJSON-972764435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.204s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:08 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-1c1cd96b-e5ce-48db-bcfe-09361651e730 tempest-VolumesServicesTestJSON-972764435 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:24:08 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-1c1cd96b-e5ce-48db-bcfe-09361651e730 tempest-VolumesServicesTestJSON-972764435 None] Deleted volume successfully. Apr 29 17:24:08 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1c1cd96b-e5ce-48db-bcfe-09361651e730 tempest-VolumesServicesTestJSON-972764435 None] Lock "cinder-cea2e844-0da2-4506-8210-d0287eb12669-delete_volume" released by "delete_volume" :: held 3.641s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:24:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-a27e3758-cc09-4597-9c58-d26c4707f69b req-f05d30a3-2438-4fe6-8860-c95658d7bfbd tempest-TestInstancesWithCinderVolumes-804517949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-a27e3758-cc09-4597-9c58-d26c4707f69b req-f05d30a3-2438-4fe6-8860-c95658d7bfbd tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:12 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c534e1-8b6b-450a-895d-d17fb591b2e4]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:24:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-a27e3758-cc09-4597-9c58-d26c4707f69b req-f05d30a3-2438-4fe6-8860-c95658d7bfbd tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:12 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c Apr 29 17:24:12 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:12 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-a27e3758-cc09-4597-9c58-d26c4707f69b req-f05d30a3-2438-4fe6-8860-c95658d7bfbd tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c" returned: 0 in 0.850s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-a27e3758-cc09-4597-9c58-d26c4707f69b req-f05d30a3-2438-4fe6-8860-c95658d7bfbd tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:13 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c Apr 29 17:24:13 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:13 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-a27e3758-cc09-4597-9c58-d26c4707f69b req-f05d30a3-2438-4fe6-8860-c95658d7bfbd tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c" returned: 1 in 1.031s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-a27e3758-cc09-4597-9c58-d26c4707f69b req-f05d30a3-2438-4fe6-8860-c95658d7bfbd tempest-TestInstancesWithCinderVolumes-804517949 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:24:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-a27e3758-cc09-4597-9c58-d26c4707f69b req-f05d30a3-2438-4fe6-8860-c95658d7bfbd tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.939s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-a27e3758-cc09-4597-9c58-d26c4707f69b req-f05d30a3-2438-4fe6-8860-c95658d7bfbd tempest-TestInstancesWithCinderVolumes-804517949 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0057a3b-2b8c-45f8-bcdb-d6785116d724', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:24:14 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-a27e3758-cc09-4597-9c58-d26c4707f69b req-f05d30a3-2438-4fe6-8860-c95658d7bfbd tempest-TestInstancesWithCinderVolumes-804517949 None] attachment_update completed successfully. Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Flow 'volume_create_manager' (f4c72dee-a726-4c04-a2ac-2be84d0114bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85787692-bcfb-4a6c-9845-f15c897290a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85787692-bcfb-4a6c-9845-f15c897290a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-477356747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae55d9073b284d918d34e6bd0c884d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:24:15Z,use_quota=True,user_id='5a2b79bf5ad94e9d9765c595f048bd31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391c66a0-a2c2-428f-a474-f157263b8b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391c66a0-a2c2-428f-a474-f157263b8b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f60323a8-edf9-4416-ad39-62bfab32dac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f60323a8-edf9-4416-ad39-62bfab32dac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb', 'volume_name': 'volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a29e9c4-ef85-452a-802d-a3a4805b47a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a29e9c4-ef85-452a-802d-a3a4805b47a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa13b26e-ffd2-4032-a198-d736532e66b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:15 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Volume c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb', 'volume_size': 1} Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-477356747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae55d9073b284d918d34e6bd0c884d3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:24:15Z,use_quota=True,user_id='5a2b79bf5ad94e9d9765c595f048bd31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Creating volume c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:24:15 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:24:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:15 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb 1073741824 Apr 29 17:24:15 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:16 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb 1073741824" returned: 0 in 0.908s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:16 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb Apr 29 17:24:16 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:16 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb" returned: 0 in 0.623s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:16 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:24:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa13b26e-ffd2-4032-a198-d736532e66b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61fde91-22b1-4ea0-88ca-0e8f8d8ec260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:16 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Volume volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb (c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb): created successfully Apr 29 17:24:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61fde91-22b1-4ea0-88ca-0e8f8d8ec260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Flow 'volume_create_manager' (f4c72dee-a726-4c04-a2ac-2be84d0114bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:24:16 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-df514335-2c58-4115-98f9-ebaabb9e4bd8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Created volume successfully. Apr 29 17:24:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-08bf8e0f-a276-4c2b-b7d0-b76d22dc9d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-08bf8e0f-a276-4c2b-b7d0-b76d22dc9d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-08bf8e0f-a276-4c2b-b7d0-b76d22dc9d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Creating offline snapshot b40835ed-5334-4ac4-9dc7-ab32a512e6bc of volume c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:24:17 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[0219aa12-7ddb-4e29-aef0-a47ecda39f82]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:24:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-08bf8e0f-a276-4c2b-b7d0-b76d22dc9d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:17 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb Apr 29 17:24:17 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:18 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-08bf8e0f-a276-4c2b-b7d0-b76d22dc9d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb" returned: 0 in 1.026s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-08bf8e0f-a276-4c2b-b7d0-b76d22dc9d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.b40835ed-5334-4ac4-9dc7-ab32a512e6bc 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:18 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.b40835ed-5334-4ac4-9dc7-ab32a512e6bc 1G Apr 29 17:24:18 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:19 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-08bf8e0f-a276-4c2b-b7d0-b76d22dc9d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.b40835ed-5334-4ac4-9dc7-ab32a512e6bc 1G" returned: 0 in 0.868s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-08bf8e0f-a276-4c2b-b7d0-b76d22dc9d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.b40835ed-5334-4ac4-9dc7-ab32a512e6bc {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:19 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.b40835ed-5334-4ac4-9dc7-ab32a512e6bc Apr 29 17:24:19 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:20 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-08bf8e0f-a276-4c2b-b7d0-b76d22dc9d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.b40835ed-5334-4ac4-9dc7-ab32a512e6bc" returned: 0 in 1.032s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:20 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-08bf8e0f-a276-4c2b-b7d0-b76d22dc9d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.b40835ed-5334-4ac4-9dc7-ab32a512e6bc is being set with open permissions: ugo+rw Apr 29 17:24:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-08bf8e0f-a276-4c2b-b7d0-b76d22dc9d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.b40835ed-5334-4ac4-9dc7-ab32a512e6bc {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:20 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.b40835ed-5334-4ac4-9dc7-ab32a512e6bc Apr 29 17:24:20 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:21 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-08bf8e0f-a276-4c2b-b7d0-b76d22dc9d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.b40835ed-5334-4ac4-9dc7-ab32a512e6bc" returned: 0 in 1.221s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-08bf8e0f-a276-4c2b-b7d0-b76d22dc9d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:21 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.info Apr 29 17:24:21 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:23 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-08bf8e0f-a276-4c2b-b7d0-b76d22dc9d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.info" returned: 0 in 1.390s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:23 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-08bf8e0f-a276-4c2b-b7d0-b76d22dc9d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.info is being set with open permissions: ugo+rw Apr 29 17:24:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-08bf8e0f-a276-4c2b-b7d0-b76d22dc9d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:23 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.info Apr 29 17:24:23 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:24 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-08bf8e0f-a276-4c2b-b7d0-b76d22dc9d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.info" returned: 0 in 1.200s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-08bf8e0f-a276-4c2b-b7d0-b76d22dc9d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.872s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:24 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-08bf8e0f-a276-4c2b-b7d0-b76d22dc9d83 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Create snapshot completed successfully Apr 29 17:24:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Acquiring lock "cinder-b40835ed-5334-4ac4-9dc7-ab32a512e6bc-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:24:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Lock "cinder-b40835ed-5334-4ac4-9dc7-ab32a512e6bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:24:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Acquiring lock "cinder-quobyte-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:24:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Lock "cinder-quobyte-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb" acquired by "delete_snapshot" :: waited 0.041s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:24:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Acquiring lock "cinder-quobyte-b40835ed-5334-4ac4-9dc7-ab32a512e6bc" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:24:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Lock "cinder-quobyte-b40835ed-5334-4ac4-9dc7-ab32a512e6bc" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:24:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Deleting offline snapshot b40835ed-5334-4ac4-9dc7-ab32a512e6bc of volume c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:24:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] snapshot_file for this snap is: volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.b40835ed-5334-4ac4-9dc7-ab32a512e6bc {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:24:26 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[367e165e-4187-4e51-ac77-7ca876b83586]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:24:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.b40835ed-5334-4ac4-9dc7-ab32a512e6bc {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:26 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.b40835ed-5334-4ac4-9dc7-ab32a512e6bc Apr 29 17:24:26 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:27 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.b40835ed-5334-4ac4-9dc7-ab32a512e6bc" returned: 0 in 1.168s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:27 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:24:27 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e0b7da-aaa1-42ba-b262-0c958fee9521]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:24:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:27 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb Apr 29 17:24:27 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:28 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb" returned: 0 in 1.232s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.b40835ed-5334-4ac4-9dc7-ab32a512e6bc {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:28 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.b40835ed-5334-4ac4-9dc7-ab32a512e6bc Apr 29 17:24:28 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:29 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.b40835ed-5334-4ac4-9dc7-ab32a512e6bc" returned: 0 in 1.376s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.b40835ed-5334-4ac4-9dc7-ab32a512e6bc {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:30 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.b40835ed-5334-4ac4-9dc7-ab32a512e6bc Apr 29 17:24:30 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d7d7505f-4f73-4100-885d-0a4520cc4ba9 tempest-AttachVolumeShelveTestJSON-737584018 None] Acquiring lock "cinder-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:24:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d7d7505f-4f73-4100-885d-0a4520cc4ba9 tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "cinder-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:24:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d7d7505f-4f73-4100-885d-0a4520cc4ba9 tempest-AttachVolumeShelveTestJSON-737584018 None] Acquiring lock "cinder-quobyte-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:24:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d7d7505f-4f73-4100-885d-0a4520cc4ba9 tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "cinder-quobyte-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779" acquired by "delete_volume" :: waited 0.040s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:24:30 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7924ef-d987-4bc5-926e-9cf85ba53573]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:24:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7d7505f-4f73-4100-885d-0a4520cc4ba9 tempest-AttachVolumeShelveTestJSON-737584018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:31 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb.b40835ed-5334-4ac4-9dc7-ab32a512e6bc" returned: 0 in 1.207s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:31 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779 Apr 29 17:24:31 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Lock "cinder-quobyte-b40835ed-5334-4ac4-9dc7-ab32a512e6bc" released by "_delete_snapshot" :: held 5.197s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:24:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Lock "cinder-quobyte-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb" released by "delete_snapshot" :: held 5.251s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:24:31 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Created reservations ['b65ac458-f83a-4130-ae0b-a4f94cdea748', '00d2ecb7-2713-4acb-8f74-fdf27cbc8d0d', '842c4673-e95f-42ca-bf92-3fa44f92375f', '944db6b8-5aaf-49c3-9209-0605be95f624'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:24:31 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Delete snapshot completed successfully. Apr 29 17:24:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3a52caf2-5b86-48d2-9f05-38d2cd928ddb tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Lock "cinder-b40835ed-5334-4ac4-9dc7-ab32a512e6bc-delete_snapshot" released by "delete_snapshot" :: held 5.546s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:24:32 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7d7505f-4f73-4100-885d-0a4520cc4ba9 tempest-AttachVolumeShelveTestJSON-737584018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779" returned: 0 in 1.286s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7d7505f-4f73-4100-885d-0a4520cc4ba9 tempest-AttachVolumeShelveTestJSON-737584018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:32 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779 Apr 29 17:24:32 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-19e0d260-8fd4-4a77-b7a3-eded560e8802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Acquiring lock "cinder-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:24:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-19e0d260-8fd4-4a77-b7a3-eded560e8802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Lock "cinder-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:24:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-19e0d260-8fd4-4a77-b7a3-eded560e8802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Acquiring lock "cinder-quobyte-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:24:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-19e0d260-8fd4-4a77-b7a3-eded560e8802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Lock "cinder-quobyte-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb" acquired by "delete_volume" :: waited 0.025s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:24:32 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[8018f194-dd2e-453b-a4db-bf0963b51ef3]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:24:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-19e0d260-8fd4-4a77-b7a3-eded560e8802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:33 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb Apr 29 17:24:33 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:33 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7d7505f-4f73-4100-885d-0a4520cc4ba9 tempest-AttachVolumeShelveTestJSON-737584018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779" returned: 0 in 1.217s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:33 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d7d7505f-4f73-4100-885d-0a4520cc4ba9 tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "cinder-quobyte-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779" released by "delete_volume" :: held 2.592s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:24:33 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=67,cinder:SELECT=68,cinder:INSERT=16,cinder:DELETE=11 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:24:33 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-d7d7505f-4f73-4100-885d-0a4520cc4ba9 tempest-AttachVolumeShelveTestJSON-737584018 None] Created reservations ['31e4b01f-8deb-4df0-8174-4e957aa10f8d', '93f8a03e-23f4-47cb-b03c-217bbc55973c', '09cc4ffc-f4c9-412c-91b2-811f8bfc58fa', '8bb34ed8-f0b0-4532-b594-4a6113e03b51'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:24:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d7d7505f-4f73-4100-885d-0a4520cc4ba9 tempest-AttachVolumeShelveTestJSON-737584018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d7d7505f-4f73-4100-885d-0a4520cc4ba9 tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d7d7505f-4f73-4100-885d-0a4520cc4ba9 tempest-AttachVolumeShelveTestJSON-737584018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:24:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d7d7505f-4f73-4100-885d-0a4520cc4ba9 tempest-AttachVolumeShelveTestJSON-737584018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:24:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d7d7505f-4f73-4100-885d-0a4520cc4ba9 tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7d7505f-4f73-4100-885d-0a4520cc4ba9 tempest-AttachVolumeShelveTestJSON-737584018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:33 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:24:33 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad8623ee-f5a2-4fed-9497-03db1a0e252f tempest-AttachVolumeShelveTestJSON-737584018 None] Acquiring lock "cinder-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:24:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad8623ee-f5a2-4fed-9497-03db1a0e252f tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "cinder-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:24:34 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=69,cinder:UPDATE=84,cinder:INSERT=26,cinder:DELETE=2 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:24:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad8623ee-f5a2-4fed-9497-03db1a0e252f tempest-AttachVolumeShelveTestJSON-737584018 None] Acquiring lock "cinder-quobyte-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:24:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad8623ee-f5a2-4fed-9497-03db1a0e252f tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "cinder-quobyte-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d" acquired by "delete_volume" :: waited 0.038s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:24:34 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-19e0d260-8fd4-4a77-b7a3-eded560e8802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb" returned: 0 in 1.866s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-19e0d260-8fd4-4a77-b7a3-eded560e8802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:34 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2925754-13f1-4531-898f-3394c07cdc6e]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:24:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad8623ee-f5a2-4fed-9497-03db1a0e252f tempest-AttachVolumeShelveTestJSON-737584018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:34 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb Apr 29 17:24:34 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:35 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d Apr 29 17:24:35 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:35 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d7d7505f-4f73-4100-885d-0a4520cc4ba9 tempest-AttachVolumeShelveTestJSON-737584018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.450s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:35 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-d7d7505f-4f73-4100-885d-0a4520cc4ba9 tempest-AttachVolumeShelveTestJSON-737584018 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:24:35 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d7d7505f-4f73-4100-885d-0a4520cc4ba9 tempest-AttachVolumeShelveTestJSON-737584018 None] Deleted volume successfully. Apr 29 17:24:35 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d7d7505f-4f73-4100-885d-0a4520cc4ba9 tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "cinder-7bed76a9-b0b9-4a11-9baf-8c0bdfcb6779-delete_volume" released by "delete_volume" :: held 4.473s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:24:35 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-19e0d260-8fd4-4a77-b7a3-eded560e8802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb" returned: 0 in 0.847s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:35 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-19e0d260-8fd4-4a77-b7a3-eded560e8802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Lock "cinder-quobyte-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb" released by "delete_volume" :: held 2.814s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:24:35 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-19e0d260-8fd4-4a77-b7a3-eded560e8802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Created reservations ['d4a76be4-96be-4a4f-bcee-554ef17e92aa', '044ecaa7-147c-4244-ac89-4c1a238780f2', '9d82b811-15bc-41ff-944e-e90fdc712002', 'bb858e4b-a953-4b65-a700-4bd600f8dd6e'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:24:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-19e0d260-8fd4-4a77-b7a3-eded560e8802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-19e0d260-8fd4-4a77-b7a3-eded560e8802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:35 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-19e0d260-8fd4-4a77-b7a3-eded560e8802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:24:35 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-19e0d260-8fd4-4a77-b7a3-eded560e8802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:24:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-19e0d260-8fd4-4a77-b7a3-eded560e8802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-19e0d260-8fd4-4a77-b7a3-eded560e8802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:36 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:24:36 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:36 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad8623ee-f5a2-4fed-9497-03db1a0e252f tempest-AttachVolumeShelveTestJSON-737584018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d" returned: 0 in 1.272s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad8623ee-f5a2-4fed-9497-03db1a0e252f tempest-AttachVolumeShelveTestJSON-737584018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:36 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d Apr 29 17:24:36 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:36 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-19e0d260-8fd4-4a77-b7a3-eded560e8802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.031s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:36 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-19e0d260-8fd4-4a77-b7a3-eded560e8802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:24:37 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-19e0d260-8fd4-4a77-b7a3-eded560e8802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Deleted volume successfully. Apr 29 17:24:37 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-19e0d260-8fd4-4a77-b7a3-eded560e8802 tempest-VolumeSnapshotQuotasNegativeTestJSON-1420692467 None] Lock "cinder-c4fa5e3d-eabb-4753-8544-0ee4d4ec39cb-delete_volume" released by "delete_volume" :: held 4.342s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:24:37 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad8623ee-f5a2-4fed-9497-03db1a0e252f tempest-AttachVolumeShelveTestJSON-737584018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d" returned: 0 in 1.168s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:37 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad8623ee-f5a2-4fed-9497-03db1a0e252f tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "cinder-quobyte-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d" released by "delete_volume" :: held 2.540s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:24:37 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-ad8623ee-f5a2-4fed-9497-03db1a0e252f tempest-AttachVolumeShelveTestJSON-737584018 None] Created reservations ['fb1e1e45-b799-4923-b676-7ff369726585', '87a78c98-8efb-4124-8019-5dafc7a363dd', '3c510e94-53ce-4ab6-9a8d-9623f8a10737', '9c9c3c52-42e2-42a8-9ecc-adb931734f61'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:24:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ad8623ee-f5a2-4fed-9497-03db1a0e252f tempest-AttachVolumeShelveTestJSON-737584018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ad8623ee-f5a2-4fed-9497-03db1a0e252f tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ad8623ee-f5a2-4fed-9497-03db1a0e252f tempest-AttachVolumeShelveTestJSON-737584018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:24:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ad8623ee-f5a2-4fed-9497-03db1a0e252f tempest-AttachVolumeShelveTestJSON-737584018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:24:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ad8623ee-f5a2-4fed-9497-03db1a0e252f tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad8623ee-f5a2-4fed-9497-03db1a0e252f tempest-AttachVolumeShelveTestJSON-737584018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:37 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:24:37 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:38 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad8623ee-f5a2-4fed-9497-03db1a0e252f tempest-AttachVolumeShelveTestJSON-737584018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.989s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:38 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-ad8623ee-f5a2-4fed-9497-03db1a0e252f tempest-AttachVolumeShelveTestJSON-737584018 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:24:38 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ad8623ee-f5a2-4fed-9497-03db1a0e252f tempest-AttachVolumeShelveTestJSON-737584018 None] Deleted volume successfully. Apr 29 17:24:38 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad8623ee-f5a2-4fed-9497-03db1a0e252f tempest-AttachVolumeShelveTestJSON-737584018 None] Lock "cinder-83180f1b-b0c3-4ca7-b33d-9328a9b8cc3d-delete_volume" released by "delete_volume" :: held 3.951s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Flow 'volume_create_manager' (21387fe1-0f77-4763-a2ea-09cecbfdb8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a8832e-8a6d-4c42-9657-ff36015d4fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a8832e-8a6d-4c42-9657-ff36015d4fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1440258412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f6e288a-e2cc-491e-bc50-691edf9d54da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0edb6c268341de8235189d83728e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:24:43Z,use_quota=True,user_id='7cf0dda99979412e88e12e979b479cef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53cf239b-89e2-48ce-8214-203f0c2e47c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53cf239b-89e2-48ce-8214-203f0c2e47c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba8221e-2a0d-4ec2-8018-f5e00fb0c890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba8221e-2a0d-4ec2-8018-f5e00fb0c890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f6e288a-e2cc-491e-bc50-691edf9d54da', 'volume_name': 'volume-3f6e288a-e2cc-491e-bc50-691edf9d54da', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abd8477-85e8-4895-9cd3-6938d8e36b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abd8477-85e8-4895-9cd3-6938d8e36b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa31ea27-6354-4d4e-99bd-3d1af2a5d9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:43 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Volume 3f6e288a-e2cc-491e-bc50-691edf9d54da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f6e288a-e2cc-491e-bc50-691edf9d54da', 'volume_size': 1} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1440258412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f6e288a-e2cc-491e-bc50-691edf9d54da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0edb6c268341de8235189d83728e2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:24:43Z,use_quota=True,user_id='7cf0dda99979412e88e12e979b479cef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Creating volume 3f6e288a-e2cc-491e-bc50-691edf9d54da {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:24:43 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f6e288a-e2cc-491e-bc50-691edf9d54da 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:43 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f6e288a-e2cc-491e-bc50-691edf9d54da 1073741824 Apr 29 17:24:43 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Flow 'volume_create_manager' (efbfdbe5-d5be-4056-bb6c-677d93d96df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cacb54f-934b-4d1b-b6d7-0b91aa4d572d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cacb54f-934b-4d1b-b6d7-0b91aa4d572d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-287288762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9494e57a-3679-4ea8-8380-f2b712c49f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d81c51967ed4434b9a2bcdbee20b1d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:24:43Z,use_quota=True,user_id='a8fc6ade204e4af58fca3149fa9b851f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70bb0b0f-366e-4337-862d-1f891b54700a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70bb0b0f-366e-4337-862d-1f891b54700a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2963e7-cd81-4098-98f6-984ae574c768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2963e7-cd81-4098-98f6-984ae574c768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9494e57a-3679-4ea8-8380-f2b712c49f46', 'volume_name': 'volume-9494e57a-3679-4ea8-8380-f2b712c49f46', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2450132d-59c9-4914-92bb-eea0a1871976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2450132d-59c9-4914-92bb-eea0a1871976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c3bf4d-041c-42e2-9c47-bb7026c854bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:43 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Volume 9494e57a-3679-4ea8-8380-f2b712c49f46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9494e57a-3679-4ea8-8380-f2b712c49f46', 'volume_size': 1} Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:43 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f6e288a-e2cc-491e-bc50-691edf9d54da 1073741824" returned: 0 in 0.852s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f6e288a-e2cc-491e-bc50-691edf9d54da {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:44 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f6e288a-e2cc-491e-bc50-691edf9d54da Apr 29 17:24:44 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:44 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f6e288a-e2cc-491e-bc50-691edf9d54da" returned: 0 in 0.622s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:24:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.328s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-287288762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9494e57a-3679-4ea8-8380-f2b712c49f46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d81c51967ed4434b9a2bcdbee20b1d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:24:43Z,use_quota=True,user_id='a8fc6ade204e4af58fca3149fa9b851f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:24:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Creating volume 9494e57a-3679-4ea8-8380-f2b712c49f46 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:24:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:24:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:24:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:24:44 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:24:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:44 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46 1073741824 Apr 29 17:24:44 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa31ea27-6354-4d4e-99bd-3d1af2a5d9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f6e288a-e2cc-491e-bc50-691edf9d54da', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0a1e6e-65e9-4c51-b95c-ff9a5134590b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:44 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Volume volume-3f6e288a-e2cc-491e-bc50-691edf9d54da (3f6e288a-e2cc-491e-bc50-691edf9d54da): created successfully Apr 29 17:24:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0a1e6e-65e9-4c51-b95c-ff9a5134590b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Flow 'volume_create_manager' (21387fe1-0f77-4763-a2ea-09cecbfdb8d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:24:44 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-c3c7ebc8-ca4b-4ea8-998b-661ad37df498 tempest-VolumesMetadataTest-890294597 None] Created volume successfully. Apr 29 17:24:45 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46 1073741824" returned: 0 in 0.894s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:45 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46 Apr 29 17:24:45 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:45 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-501df76e-dc05-4a4f-8781-68b4eb210ee2 tempest-VolumesMetadataTest-890294597 None] Acquiring lock "cinder-3f6e288a-e2cc-491e-bc50-691edf9d54da-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:24:45 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-501df76e-dc05-4a4f-8781-68b4eb210ee2 tempest-VolumesMetadataTest-890294597 None] Lock "cinder-3f6e288a-e2cc-491e-bc50-691edf9d54da-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:24:45 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-501df76e-dc05-4a4f-8781-68b4eb210ee2 tempest-VolumesMetadataTest-890294597 None] Acquiring lock "cinder-quobyte-3f6e288a-e2cc-491e-bc50-691edf9d54da" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:24:45 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-501df76e-dc05-4a4f-8781-68b4eb210ee2 tempest-VolumesMetadataTest-890294597 None] Lock "cinder-quobyte-3f6e288a-e2cc-491e-bc50-691edf9d54da" acquired by "delete_volume" :: waited 0.024s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:24:46 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[18591113-1911-4e44-b49c-182d170f20fe]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:24:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-501df76e-dc05-4a4f-8781-68b4eb210ee2 tempest-VolumesMetadataTest-890294597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f6e288a-e2cc-491e-bc50-691edf9d54da {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:46 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f6e288a-e2cc-491e-bc50-691edf9d54da Apr 29 17:24:46 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:46 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46" returned: 0 in 0.883s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:24:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c3bf4d-041c-42e2-9c47-bb7026c854bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9494e57a-3679-4ea8-8380-f2b712c49f46', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71194128-4562-4005-93de-ecb3fca2292b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:46 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Volume volume-9494e57a-3679-4ea8-8380-f2b712c49f46 (9494e57a-3679-4ea8-8380-f2b712c49f46): created successfully Apr 29 17:24:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71194128-4562-4005-93de-ecb3fca2292b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Flow 'volume_create_manager' (efbfdbe5-d5be-4056-bb6c-677d93d96df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:24:46 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-68e7249e-2e82-404c-ac1f-4bf1c1a469a3 tempest-SnapshotMetadataTestJSON-619704602 None] Created volume successfully. Apr 29 17:24:46 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-501df76e-dc05-4a4f-8781-68b4eb210ee2 tempest-VolumesMetadataTest-890294597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f6e288a-e2cc-491e-bc50-691edf9d54da" returned: 0 in 0.961s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-501df76e-dc05-4a4f-8781-68b4eb210ee2 tempest-VolumesMetadataTest-890294597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f6e288a-e2cc-491e-bc50-691edf9d54da {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:47 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f6e288a-e2cc-491e-bc50-691edf9d54da Apr 29 17:24:47 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a35603ae-eb71-4eb3-80fd-09a189ace403 tempest-SnapshotMetadataTestJSON-619704602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a35603ae-eb71-4eb3-80fd-09a189ace403 tempest-SnapshotMetadataTestJSON-619704602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-a35603ae-eb71-4eb3-80fd-09a189ace403 tempest-SnapshotMetadataTestJSON-619704602 None] Creating offline snapshot 8502fd10-ed9d-49a5-a1ba-ef7156573504 of volume 9494e57a-3679-4ea8-8380-f2b712c49f46 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:24:47 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-501df76e-dc05-4a4f-8781-68b4eb210ee2 tempest-VolumesMetadataTest-890294597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f6e288a-e2cc-491e-bc50-691edf9d54da" returned: 0 in 0.670s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:47 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a3e866-eb60-49d1-811d-7278baa2ace0]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:24:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a35603ae-eb71-4eb3-80fd-09a189ace403 tempest-SnapshotMetadataTestJSON-619704602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:47 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-501df76e-dc05-4a4f-8781-68b4eb210ee2 tempest-VolumesMetadataTest-890294597 None] Lock "cinder-quobyte-3f6e288a-e2cc-491e-bc50-691edf9d54da" released by "delete_volume" :: held 1.693s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:24:47 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-501df76e-dc05-4a4f-8781-68b4eb210ee2 tempest-VolumesMetadataTest-890294597 None] Created reservations ['f91f3a34-d893-47c6-8922-6ab4a628d699', 'd1a6fe7c-c5ce-4906-99f9-d1913004c750', '6b28c05c-829f-4d57-b7f3-ace1bcf4627a', '40d09168-711c-410c-b1e2-d0802566e2ab'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:24:47 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46 Apr 29 17:24:47 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-501df76e-dc05-4a4f-8781-68b4eb210ee2 tempest-VolumesMetadataTest-890294597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-501df76e-dc05-4a4f-8781-68b4eb210ee2 tempest-VolumesMetadataTest-890294597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-501df76e-dc05-4a4f-8781-68b4eb210ee2 tempest-VolumesMetadataTest-890294597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:24:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-501df76e-dc05-4a4f-8781-68b4eb210ee2 tempest-VolumesMetadataTest-890294597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:24:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-501df76e-dc05-4a4f-8781-68b4eb210ee2 tempest-VolumesMetadataTest-890294597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-501df76e-dc05-4a4f-8781-68b4eb210ee2 tempest-VolumesMetadataTest-890294597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:47 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:24:47 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:48 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-501df76e-dc05-4a4f-8781-68b4eb210ee2 tempest-VolumesMetadataTest-890294597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.982s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:48 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-501df76e-dc05-4a4f-8781-68b4eb210ee2 tempest-VolumesMetadataTest-890294597 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:24:48 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-501df76e-dc05-4a4f-8781-68b4eb210ee2 tempest-VolumesMetadataTest-890294597 None] Deleted volume successfully. Apr 29 17:24:48 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-501df76e-dc05-4a4f-8781-68b4eb210ee2 tempest-VolumesMetadataTest-890294597 None] Lock "cinder-3f6e288a-e2cc-491e-bc50-691edf9d54da-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:24:48 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a35603ae-eb71-4eb3-80fd-09a189ace403 tempest-SnapshotMetadataTestJSON-619704602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46" returned: 0 in 1.227s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a35603ae-eb71-4eb3-80fd-09a189ace403 tempest-SnapshotMetadataTestJSON-619704602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.8502fd10-ed9d-49a5-a1ba-ef7156573504 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:48 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.8502fd10-ed9d-49a5-a1ba-ef7156573504 1G Apr 29 17:24:48 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:49 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a35603ae-eb71-4eb3-80fd-09a189ace403 tempest-SnapshotMetadataTestJSON-619704602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.8502fd10-ed9d-49a5-a1ba-ef7156573504 1G" returned: 0 in 0.943s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a35603ae-eb71-4eb3-80fd-09a189ace403 tempest-SnapshotMetadataTestJSON-619704602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9494e57a-3679-4ea8-8380-f2b712c49f46 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.8502fd10-ed9d-49a5-a1ba-ef7156573504 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:49 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9494e57a-3679-4ea8-8380-f2b712c49f46 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.8502fd10-ed9d-49a5-a1ba-ef7156573504 Apr 29 17:24:49 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:50 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a35603ae-eb71-4eb3-80fd-09a189ace403 tempest-SnapshotMetadataTestJSON-619704602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9494e57a-3679-4ea8-8380-f2b712c49f46 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.8502fd10-ed9d-49a5-a1ba-ef7156573504" returned: 0 in 0.715s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:50 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-a35603ae-eb71-4eb3-80fd-09a189ace403 tempest-SnapshotMetadataTestJSON-619704602 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.8502fd10-ed9d-49a5-a1ba-ef7156573504 is being set with open permissions: ugo+rw Apr 29 17:24:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a35603ae-eb71-4eb3-80fd-09a189ace403 tempest-SnapshotMetadataTestJSON-619704602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.8502fd10-ed9d-49a5-a1ba-ef7156573504 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:50 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.8502fd10-ed9d-49a5-a1ba-ef7156573504 Apr 29 17:24:50 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:51 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a35603ae-eb71-4eb3-80fd-09a189ace403 tempest-SnapshotMetadataTestJSON-619704602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.8502fd10-ed9d-49a5-a1ba-ef7156573504" returned: 0 in 0.789s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a35603ae-eb71-4eb3-80fd-09a189ace403 tempest-SnapshotMetadataTestJSON-619704602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:51 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.info Apr 29 17:24:51 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-5e66aa6f-05fe-4243-a94e-6de25cb9369d req-d7ef55a5-0c2a-4ed5-b1e3-571a6851e9be tempest-TestInstancesWithCinderVolumes-804517949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:52 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a35603ae-eb71-4eb3-80fd-09a189ace403 tempest-SnapshotMetadataTestJSON-619704602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.info" returned: 0 in 0.914s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:52 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-a35603ae-eb71-4eb3-80fd-09a189ace403 tempest-SnapshotMetadataTestJSON-619704602 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.info is being set with open permissions: ugo+rw Apr 29 17:24:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a35603ae-eb71-4eb3-80fd-09a189ace403 tempest-SnapshotMetadataTestJSON-619704602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:52 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.info Apr 29 17:24:52 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:52 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a35603ae-eb71-4eb3-80fd-09a189ace403 tempest-SnapshotMetadataTestJSON-619704602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.info" returned: 0 in 0.654s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a35603ae-eb71-4eb3-80fd-09a189ace403 tempest-SnapshotMetadataTestJSON-619704602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.360s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-5e66aa6f-05fe-4243-a94e-6de25cb9369d req-d7ef55a5-0c2a-4ed5-b1e3-571a6851e9be tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.862s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0ea4c9-bb45-475f-9f12-a16a1b503444]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5e66aa6f-05fe-4243-a94e-6de25cb9369d req-d7ef55a5-0c2a-4ed5-b1e3-571a6851e9be tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8e7e01e6-de6d-44bb-9ee4-4bd68a962265 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:53 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-a35603ae-eb71-4eb3-80fd-09a189ace403 tempest-SnapshotMetadataTestJSON-619704602 None] Create snapshot completed successfully Apr 29 17:24:53 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8e7e01e6-de6d-44bb-9ee4-4bd68a962265 Apr 29 17:24:53 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Flow 'volume_create_manager' (5715014d-5914-4c50-8449-0ed7d7c8925c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542ae173-adf3-450f-8795-ea955738c40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542ae173-adf3-450f-8795-ea955738c40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1792007935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de329565-8d1c-4ab6-b6a9-52dc53705ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55b8b4693a94c6bbd567c0b47577a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:24:54Z,use_quota=True,user_id='dc73e858d4994c9981542bbf6643651a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17edc741-e6f2-4dba-bf2a-b7d6438f0647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17edc741-e6f2-4dba-bf2a-b7d6438f0647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438e29c3-8638-4442-a806-a611e7709e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438e29c3-8638-4442-a806-a611e7709e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de329565-8d1c-4ab6-b6a9-52dc53705ead', 'volume_name': 'volume-de329565-8d1c-4ab6-b6a9-52dc53705ead', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7721d33a-e07a-4277-a2c3-a0a04adac6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7721d33a-e07a-4277-a2c3-a0a04adac6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5941c4b-efb4-4cab-a614-0dd3d5667977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:53 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:53 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Volume de329565-8d1c-4ab6-b6a9-52dc53705ead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de329565-8d1c-4ab6-b6a9-52dc53705ead', 'volume_size': 1} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-5e66aa6f-05fe-4243-a94e-6de25cb9369d req-d7ef55a5-0c2a-4ed5-b1e3-571a6851e9be tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8e7e01e6-de6d-44bb-9ee4-4bd68a962265" returned: 0 in 0.842s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-5e66aa6f-05fe-4243-a94e-6de25cb9369d req-d7ef55a5-0c2a-4ed5-b1e3-571a6851e9be tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.869s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1792007935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de329565-8d1c-4ab6-b6a9-52dc53705ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55b8b4693a94c6bbd567c0b47577a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:24:54Z,use_quota=True,user_id='dc73e858d4994c9981542bbf6643651a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Creating volume de329565-8d1c-4ab6-b6a9-52dc53705ead {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:24:53 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de329565-8d1c-4ab6-b6a9-52dc53705ead 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:53 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de329565-8d1c-4ab6-b6a9-52dc53705ead 1073741824 Apr 29 17:24:53 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-5e66aa6f-05fe-4243-a94e-6de25cb9369d req-d7ef55a5-0c2a-4ed5-b1e3-571a6851e9be tempest-TestInstancesWithCinderVolumes-804517949 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-8e7e01e6-de6d-44bb-9ee4-4bd68a962265', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70f537bd-21c6-4f83-a2ba-756979c03ee5', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:24:54 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-5e66aa6f-05fe-4243-a94e-6de25cb9369d req-d7ef55a5-0c2a-4ed5-b1e3-571a6851e9be tempest-TestInstancesWithCinderVolumes-804517949 None] attachment_update completed successfully. Apr 29 17:24:54 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de329565-8d1c-4ab6-b6a9-52dc53705ead 1073741824" returned: 0 in 0.958s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] Acquiring lock "cinder-8502fd10-ed9d-49a5-a1ba-ef7156573504-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:24:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] Lock "cinder-8502fd10-ed9d-49a5-a1ba-ef7156573504-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:24:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] Acquiring lock "cinder-quobyte-9494e57a-3679-4ea8-8380-f2b712c49f46" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:24:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] Lock "cinder-quobyte-9494e57a-3679-4ea8-8380-f2b712c49f46" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:24:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] Acquiring lock "cinder-quobyte-8502fd10-ed9d-49a5-a1ba-ef7156573504" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:24:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de329565-8d1c-4ab6-b6a9-52dc53705ead {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:54 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de329565-8d1c-4ab6-b6a9-52dc53705ead Apr 29 17:24:54 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] Lock "cinder-quobyte-8502fd10-ed9d-49a5-a1ba-ef7156573504" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:24:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] Deleting offline snapshot 8502fd10-ed9d-49a5-a1ba-ef7156573504 of volume 9494e57a-3679-4ea8-8380-f2b712c49f46 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:24:55 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] snapshot_file for this snap is: volume-9494e57a-3679-4ea8-8380-f2b712c49f46.8502fd10-ed9d-49a5-a1ba-ef7156573504 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:24:55 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c567482-500c-4834-a304-72f0f06a4507]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:24:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.8502fd10-ed9d-49a5-a1ba-ef7156573504 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:55 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.8502fd10-ed9d-49a5-a1ba-ef7156573504 Apr 29 17:24:55 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:55 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de329565-8d1c-4ab6-b6a9-52dc53705ead" returned: 0 in 0.688s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:55 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:24:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:24:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5941c4b-efb4-4cab-a614-0dd3d5667977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de329565-8d1c-4ab6-b6a9-52dc53705ead', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c0d5ba-a4d3-462e-9ab5-f0bbf2d77292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:24:55 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Volume volume-de329565-8d1c-4ab6-b6a9-52dc53705ead (de329565-8d1c-4ab6-b6a9-52dc53705ead): created successfully Apr 29 17:24:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c0d5ba-a4d3-462e-9ab5-f0bbf2d77292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:24:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Flow 'volume_create_manager' (5715014d-5914-4c50-8449-0ed7d7c8925c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:24:55 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-b456cc35-5dac-46f5-94e6-48f521495fec tempest-VolumesTransfersTest-1597720612 None] Created volume successfully. Apr 29 17:24:55 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.8502fd10-ed9d-49a5-a1ba-ef7156573504" returned: 0 in 0.842s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:55 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9494e57a-3679-4ea8-8380-f2b712c49f46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:24:55 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3a2f51-cd05-4b38-a7bd-e04924edaa8b]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:24:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:56 devstack sudo[102569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46 Apr 29 17:24:56 devstack sudo[102569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:56 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-cdb8ec72-dcf1-46b6-99a6-05016994cc25 tempest-VolumesTransfersTest-402862191 None] Transfer volume completed successfully. Apr 29 17:24:57 devstack sudo[102569]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46" returned: 0 in 1.131s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.8502fd10-ed9d-49a5-a1ba-ef7156573504 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:57 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.8502fd10-ed9d-49a5-a1ba-ef7156573504 Apr 29 17:24:57 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-191e07c2-d376-4be9-ae06-5cfff6b23bdf tempest-VolumesTransfersTest-113816517 None] Acquiring lock "cinder-de329565-8d1c-4ab6-b6a9-52dc53705ead-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:24:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-191e07c2-d376-4be9-ae06-5cfff6b23bdf tempest-VolumesTransfersTest-113816517 None] Lock "cinder-de329565-8d1c-4ab6-b6a9-52dc53705ead-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:24:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-191e07c2-d376-4be9-ae06-5cfff6b23bdf tempest-VolumesTransfersTest-113816517 None] Acquiring lock "cinder-quobyte-de329565-8d1c-4ab6-b6a9-52dc53705ead" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:24:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-191e07c2-d376-4be9-ae06-5cfff6b23bdf tempest-VolumesTransfersTest-113816517 None] Lock "cinder-quobyte-de329565-8d1c-4ab6-b6a9-52dc53705ead" acquired by "delete_volume" :: waited 0.023s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:24:58 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[806686c2-4491-4077-931b-598be726619c]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:24:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-191e07c2-d376-4be9-ae06-5cfff6b23bdf tempest-VolumesTransfersTest-113816517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de329565-8d1c-4ab6-b6a9-52dc53705ead {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:58 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de329565-8d1c-4ab6-b6a9-52dc53705ead Apr 29 17:24:58 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:58 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.8502fd10-ed9d-49a5-a1ba-ef7156573504" returned: 0 in 1.409s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.8502fd10-ed9d-49a5-a1ba-ef7156573504 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:58 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.8502fd10-ed9d-49a5-a1ba-ef7156573504 Apr 29 17:24:58 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:59 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-191e07c2-d376-4be9-ae06-5cfff6b23bdf tempest-VolumesTransfersTest-113816517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de329565-8d1c-4ab6-b6a9-52dc53705ead" returned: 0 in 0.944s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-191e07c2-d376-4be9-ae06-5cfff6b23bdf tempest-VolumesTransfersTest-113816517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de329565-8d1c-4ab6-b6a9-52dc53705ead {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:24:59 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46.8502fd10-ed9d-49a5-a1ba-ef7156573504" returned: 0 in 0.717s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:59 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de329565-8d1c-4ab6-b6a9-52dc53705ead Apr 29 17:24:59 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:24:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] Lock "cinder-quobyte-8502fd10-ed9d-49a5-a1ba-ef7156573504" released by "_delete_snapshot" :: held 4.322s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:24:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] Lock "cinder-quobyte-9494e57a-3679-4ea8-8380-f2b712c49f46" released by "delete_snapshot" :: held 4.377s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:24:59 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] Created reservations ['9bf59428-9823-44e0-974b-7c8b3984fe7d', '3d70bf11-e1da-45ac-aca7-e35f3e61f801', 'd17e56e6-2ffe-4542-8376-e5746fe706ca', '1cb4b7d4-0882-4c4c-b221-cf7245937f20'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:24:59 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] Delete snapshot completed successfully. Apr 29 17:24:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4aa369b7-a85c-40e2-8914-12d5f2f3b5d3 tempest-SnapshotMetadataTestJSON-619704602 None] Lock "cinder-8502fd10-ed9d-49a5-a1ba-ef7156573504-delete_snapshot" released by "delete_snapshot" :: held 4.548s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:24:59 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Apr 29 17:24:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-191e07c2-d376-4be9-ae06-5cfff6b23bdf tempest-VolumesTransfersTest-113816517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-de329565-8d1c-4ab6-b6a9-52dc53705ead" returned: 0 in 0.726s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:24:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-191e07c2-d376-4be9-ae06-5cfff6b23bdf tempest-VolumesTransfersTest-113816517 None] Lock "cinder-quobyte-de329565-8d1c-4ab6-b6a9-52dc53705ead" released by "delete_volume" :: held 1.734s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-191e07c2-d376-4be9-ae06-5cfff6b23bdf tempest-VolumesTransfersTest-113816517 None] Created reservations ['fc07eafb-265a-4f1e-a05f-89b27d0c2ccd', 'ff1420cf-2321-44b9-92c9-9675604e8cd7', '9609985d-8ca5-4ae3-9490-147fbe6a57e1', '5c2d4872-9338-4855-a862-85e3a913441b'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-191e07c2-d376-4be9-ae06-5cfff6b23bdf tempest-VolumesTransfersTest-113816517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-191e07c2-d376-4be9-ae06-5cfff6b23bdf tempest-VolumesTransfersTest-113816517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-191e07c2-d376-4be9-ae06-5cfff6b23bdf tempest-VolumesTransfersTest-113816517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-191e07c2-d376-4be9-ae06-5cfff6b23bdf tempest-VolumesTransfersTest-113816517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-191e07c2-d376-4be9-ae06-5cfff6b23bdf tempest-VolumesTransfersTest-113816517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-191e07c2-d376-4be9-ae06-5cfff6b23bdf tempest-VolumesTransfersTest-113816517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:00 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:25:00 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-897fd752-12e2-4cf0-8e5b-97430f8d5571 tempest-SnapshotMetadataTestJSON-619704602 None] Acquiring lock "cinder-9494e57a-3679-4ea8-8380-f2b712c49f46-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-897fd752-12e2-4cf0-8e5b-97430f8d5571 tempest-SnapshotMetadataTestJSON-619704602 None] Lock "cinder-9494e57a-3679-4ea8-8380-f2b712c49f46-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-897fd752-12e2-4cf0-8e5b-97430f8d5571 tempest-SnapshotMetadataTestJSON-619704602 None] Acquiring lock "cinder-quobyte-9494e57a-3679-4ea8-8380-f2b712c49f46" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-897fd752-12e2-4cf0-8e5b-97430f8d5571 tempest-SnapshotMetadataTestJSON-619704602 None] Lock "cinder-quobyte-9494e57a-3679-4ea8-8380-f2b712c49f46" acquired by "delete_volume" :: waited 0.034s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee34c5c6-1ed5-416b-8b3c-251515783e77]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-897fd752-12e2-4cf0-8e5b-97430f8d5571 tempest-SnapshotMetadataTestJSON-619704602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:00 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46 Apr 29 17:25:00 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:00 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-191e07c2-d376-4be9-ae06-5cfff6b23bdf tempest-VolumesTransfersTest-113816517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.822s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-191e07c2-d376-4be9-ae06-5cfff6b23bdf tempest-VolumesTransfersTest-113816517 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:25:00 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-191e07c2-d376-4be9-ae06-5cfff6b23bdf tempest-VolumesTransfersTest-113816517 None] Deleted volume successfully. Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Flow 'volume_create_manager' (bf85b928-185c-43eb-892c-48fb33382bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d90da5-9c4e-41f8-bebe-c1c3964373df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d90da5-9c4e-41f8-bebe-c1c3964373df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1779790853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55b8b4693a94c6bbd567c0b47577a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:25:01Z,use_quota=True,user_id='dc73e858d4994c9981542bbf6643651a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579c8fbf-af89-4360-812d-fe58a92bc8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579c8fbf-af89-4360-812d-fe58a92bc8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f94f1263-178e-4ccf-a493-4b843e37c126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f94f1263-178e-4ccf-a493-4b843e37c126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21', 'volume_name': 'volume-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c8418f-47d2-4416-b72e-2d21b081d64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c8418f-47d2-4416-b72e-2d21b081d64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04342842-9ce2-4bb5-b9e8-bf311a09eb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:01 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Volume ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21', 'volume_size': 1} Apr 29 17:25:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1779790853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55b8b4693a94c6bbd567c0b47577a72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:25:01Z,use_quota=True,user_id='dc73e858d4994c9981542bbf6643651a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:25:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Creating volume ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:25:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:25:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:25:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:25:01 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:25:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-191e07c2-d376-4be9-ae06-5cfff6b23bdf tempest-VolumesTransfersTest-113816517 None] Lock "cinder-de329565-8d1c-4ab6-b6a9-52dc53705ead-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:01 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21 1073741824 Apr 29 17:25:01 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:01 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-897fd752-12e2-4cf0-8e5b-97430f8d5571 tempest-SnapshotMetadataTestJSON-619704602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46" returned: 0 in 0.898s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-897fd752-12e2-4cf0-8e5b-97430f8d5571 tempest-SnapshotMetadataTestJSON-619704602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:01 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46 Apr 29 17:25:01 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:02 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21 1073741824" returned: 0 in 0.981s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f946cfde-9d9c-423f-beee-b5dcdc62e6a2 req-b0894bad-a369-4040-90a6-f3cff5b9fb72 tempest-TestInstancesWithCinderVolumes-804517949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:02 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-897fd752-12e2-4cf0-8e5b-97430f8d5571 tempest-SnapshotMetadataTestJSON-619704602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9494e57a-3679-4ea8-8380-f2b712c49f46" returned: 0 in 0.723s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:02 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21 Apr 29 17:25:02 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-897fd752-12e2-4cf0-8e5b-97430f8d5571 tempest-SnapshotMetadataTestJSON-619704602 None] Lock "cinder-quobyte-9494e57a-3679-4ea8-8380-f2b712c49f46" released by "delete_volume" :: held 1.694s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:02 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-897fd752-12e2-4cf0-8e5b-97430f8d5571 tempest-SnapshotMetadataTestJSON-619704602 None] Created reservations ['6520213e-c30f-4706-ae73-636c06ea48da', '88ef3553-c648-44b7-afaf-a38534d32afc', 'f200ee26-a729-499e-b996-a9b75bc37aae', '8a697954-d5e7-40ff-a418-fa5fc35c6469'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:25:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-897fd752-12e2-4cf0-8e5b-97430f8d5571 tempest-SnapshotMetadataTestJSON-619704602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-897fd752-12e2-4cf0-8e5b-97430f8d5571 tempest-SnapshotMetadataTestJSON-619704602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-897fd752-12e2-4cf0-8e5b-97430f8d5571 tempest-SnapshotMetadataTestJSON-619704602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:25:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-897fd752-12e2-4cf0-8e5b-97430f8d5571 tempest-SnapshotMetadataTestJSON-619704602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:25:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-897fd752-12e2-4cf0-8e5b-97430f8d5571 tempest-SnapshotMetadataTestJSON-619704602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-897fd752-12e2-4cf0-8e5b-97430f8d5571 tempest-SnapshotMetadataTestJSON-619704602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:02 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:25:02 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:02 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21" returned: 0 in 0.847s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] <== create_volume: return (1897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:25:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f946cfde-9d9c-423f-beee-b5dcdc62e6a2 req-b0894bad-a369-4040-90a6-f3cff5b9fb72 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.881s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:02 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[c818677a-0978-4e3b-9e83-cbef22319985]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f946cfde-9d9c-423f-beee-b5dcdc62e6a2 req-b0894bad-a369-4040-90a6-f3cff5b9fb72 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-024393cb-6b74-4858-ba4f-24821e62897d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:02 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04342842-9ce2-4bb5-b9e8-bf311a09eb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df34896-852c-407b-a35a-9d2555fa6a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-897fd752-12e2-4cf0-8e5b-97430f8d5571 tempest-SnapshotMetadataTestJSON-619704602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.810s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:03 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-897fd752-12e2-4cf0-8e5b-97430f8d5571 tempest-SnapshotMetadataTestJSON-619704602 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:25:03 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-897fd752-12e2-4cf0-8e5b-97430f8d5571 tempest-SnapshotMetadataTestJSON-619704602 None] Deleted volume successfully. Apr 29 17:25:03 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Volume volume-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21 (ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21): created successfully Apr 29 17:25:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9df34896-852c-407b-a35a-9d2555fa6a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Flow 'volume_create_manager' (bf85b928-185c-43eb-892c-48fb33382bc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:25:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-897fd752-12e2-4cf0-8e5b-97430f8d5571 tempest-SnapshotMetadataTestJSON-619704602 None] Lock "cinder-9494e57a-3679-4ea8-8380-f2b712c49f46-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:03 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-10729655-a4a6-41d5-ab4d-5673597f171b tempest-VolumesTransfersTest-1597720612 None] Created volume successfully. Apr 29 17:25:03 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-024393cb-6b74-4858-ba4f-24821e62897d Apr 29 17:25:03 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:03 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f946cfde-9d9c-423f-beee-b5dcdc62e6a2 req-b0894bad-a369-4040-90a6-f3cff5b9fb72 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-024393cb-6b74-4858-ba4f-24821e62897d" returned: 0 in 0.943s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f946cfde-9d9c-423f-beee-b5dcdc62e6a2 req-b0894bad-a369-4040-90a6-f3cff5b9fb72 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.975s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f946cfde-9d9c-423f-beee-b5dcdc62e6a2 req-b0894bad-a369-4040-90a6-f3cff5b9fb72 tempest-TestInstancesWithCinderVolumes-804517949 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-024393cb-6b74-4858-ba4f-24821e62897d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12eed6f3-f1be-4f4e-b397-440a2fd294ba', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:25:04 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-f946cfde-9d9c-423f-beee-b5dcdc62e6a2 req-b0894bad-a369-4040-90a6-f3cff5b9fb72 tempest-TestInstancesWithCinderVolumes-804517949 None] attachment_update completed successfully. Apr 29 17:25:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7e6ef4bb-34cf-4859-b9d3-5652bf72ad49 tempest-VolumesTransfersTest-113816517 None] Acquiring lock "cinder-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7e6ef4bb-34cf-4859-b9d3-5652bf72ad49 tempest-VolumesTransfersTest-113816517 None] Lock "cinder-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7e6ef4bb-34cf-4859-b9d3-5652bf72ad49 tempest-VolumesTransfersTest-113816517 None] Acquiring lock "cinder-quobyte-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7e6ef4bb-34cf-4859-b9d3-5652bf72ad49 tempest-VolumesTransfersTest-113816517 None] Lock "cinder-quobyte-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21" acquired by "delete_volume" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:04 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab86320-82d7-4afa-a50a-96d811ecd92d]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7e6ef4bb-34cf-4859-b9d3-5652bf72ad49 tempest-VolumesTransfersTest-113816517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:04 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21 Apr 29 17:25:04 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:05 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7e6ef4bb-34cf-4859-b9d3-5652bf72ad49 tempest-VolumesTransfersTest-113816517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21" returned: 0 in 0.907s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7e6ef4bb-34cf-4859-b9d3-5652bf72ad49 tempest-VolumesTransfersTest-113816517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:05 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21 Apr 29 17:25:05 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:25:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:25:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:25:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:05 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:25:05 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:06 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7e6ef4bb-34cf-4859-b9d3-5652bf72ad49 tempest-VolumesTransfersTest-113816517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21" returned: 0 in 0.711s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7e6ef4bb-34cf-4859-b9d3-5652bf72ad49 tempest-VolumesTransfersTest-113816517 None] Lock "cinder-quobyte-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21" released by "delete_volume" :: held 1.672s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:06 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.708s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:25:06 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-7e6ef4bb-34cf-4859-b9d3-5652bf72ad49 tempest-VolumesTransfersTest-113816517 None] Created reservations ['99b08b80-dc81-44d5-abda-bca3c58eae47', '2bb85c43-cd71-463b-9293-f09ba276fb84', '5231c1ba-be0e-49b0-a5a9-bc2ea80f6ded', '35e51920-e134-4f3c-a5ce-218818ddcf69'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:25:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7e6ef4bb-34cf-4859-b9d3-5652bf72ad49 tempest-VolumesTransfersTest-113816517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7e6ef4bb-34cf-4859-b9d3-5652bf72ad49 tempest-VolumesTransfersTest-113816517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7e6ef4bb-34cf-4859-b9d3-5652bf72ad49 tempest-VolumesTransfersTest-113816517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:25:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7e6ef4bb-34cf-4859-b9d3-5652bf72ad49 tempest-VolumesTransfersTest-113816517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:25:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7e6ef4bb-34cf-4859-b9d3-5652bf72ad49 tempest-VolumesTransfersTest-113816517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7e6ef4bb-34cf-4859-b9d3-5652bf72ad49 tempest-VolumesTransfersTest-113816517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:06 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:25:06 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:07 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7e6ef4bb-34cf-4859-b9d3-5652bf72ad49 tempest-VolumesTransfersTest-113816517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.710s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:07 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7e6ef4bb-34cf-4859-b9d3-5652bf72ad49 tempest-VolumesTransfersTest-113816517 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:25:07 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-7e6ef4bb-34cf-4859-b9d3-5652bf72ad49 tempest-VolumesTransfersTest-113816517 None] Deleted volume successfully. Apr 29 17:25:07 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7e6ef4bb-34cf-4859-b9d3-5652bf72ad49 tempest-VolumesTransfersTest-113816517 None] Lock "cinder-ac1d38f1-9c4f-4d85-91ac-a88cd33cdf21-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Flow 'volume_create_manager' (71e4153d-5c44-4055-b989-d619991eea5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a973f773-14b3-4647-9b76-c20affc113db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a973f773-14b3-4647-9b76-c20affc113db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-71261544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34831776-0134-4b32-9774-18057f4ad29d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca954909de904fb58ea4e76b05802cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:25:09Z,use_quota=True,user_id='fcd073b0670446ff9a6c23ed884e6d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9239199-e0b2-4840-8270-5352021a7c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9239199-e0b2-4840-8270-5352021a7c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef906a6-4e2c-4690-8dff-d37a34d17a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef906a6-4e2c-4690-8dff-d37a34d17a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34831776-0134-4b32-9774-18057f4ad29d', 'volume_name': 'volume-34831776-0134-4b32-9774-18057f4ad29d', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a006cc-8f1e-49d5-b645-b14ae80fb6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a006cc-8f1e-49d5-b645-b14ae80fb6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb02137-cd86-430c-a16f-3cff678d7f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:09 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Volume 34831776-0134-4b32-9774-18057f4ad29d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34831776-0134-4b32-9774-18057f4ad29d', 'volume_size': 1} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-71261544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34831776-0134-4b32-9774-18057f4ad29d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca954909de904fb58ea4e76b05802cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:25:09Z,use_quota=True,user_id='fcd073b0670446ff9a6c23ed884e6d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Creating volume 34831776-0134-4b32-9774-18057f4ad29d {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:25:09 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:25:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:09 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d 1073741824 Apr 29 17:25:09 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:10 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d 1073741824" returned: 0 in 1.106s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:10 devstack sudo[103065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d Apr 29 17:25:10 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:11 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d" returned: 0 in 0.803s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:25:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bb02137-cd86-430c-a16f-3cff678d7f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34831776-0134-4b32-9774-18057f4ad29d', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa020e6b-c346-4182-9024-886346cd91a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:11 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Volume volume-34831776-0134-4b32-9774-18057f4ad29d (34831776-0134-4b32-9774-18057f4ad29d): created successfully Apr 29 17:25:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa020e6b-c346-4182-9024-886346cd91a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Flow 'volume_create_manager' (71e4153d-5c44-4055-b989-d619991eea5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:25:11 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-975f16a6-3c2f-4901-8a1e-9747f09bcf59 tempest-VolumesDeleteCascade-1185488377 None] Created volume successfully. Apr 29 17:25:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6d7a6299-c528-4f66-83cc-3deda079ae71 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6d7a6299-c528-4f66-83cc-3deda079ae71 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-6d7a6299-c528-4f66-83cc-3deda079ae71 tempest-VolumesDeleteCascade-1185488377 None] Creating offline snapshot 3b804098-c68d-4c88-a370-e70c6fbe1bdd of volume 34831776-0134-4b32-9774-18057f4ad29d {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:25:12 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[18df4962-cbc6-46d2-bf15-b418c208f913]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6d7a6299-c528-4f66-83cc-3deda079ae71 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:13 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d Apr 29 17:25:13 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:13 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6d7a6299-c528-4f66-83cc-3deda079ae71 tempest-VolumesDeleteCascade-1185488377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d" returned: 0 in 0.826s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6d7a6299-c528-4f66-83cc-3deda079ae71 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:13 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd 1G Apr 29 17:25:13 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:14 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:25:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Flow 'volume_create_manager' (9d0f5cbd-4bea-49fa-b68c-1c46535a3c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:25:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b1f0a7-ae71-47ab-9bfb-7c9e0a902670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b1f0a7-ae71-47ab-9bfb-7c9e0a902670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-201579126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fbdf2b9-808f-40d2-a437-20ce3931f9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd1f3bb543847dcbc5ef8fc962f31b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:25:14Z,use_quota=True,user_id='fed2314e56b041f094a8ebf1f5957504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d44497c-091d-436c-a4f0-de1839cc26db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d44497c-091d-436c-a4f0-de1839cc26db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2580d17-5514-487c-952b-8bd878931eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:14 devstack cinder-volume[84547]: DEBUG cinder.image.glance [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Creating Keystone auth plugin from conf {{(pid=84547) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 17:25:14 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-1b2db560-b330-4881-ad61-2ae0d6f7ca85 req-fc5e64b5-3988-4962-aeee-a875c13110b3 tempest-TestInstancesWithCinderVolumes-804517949 None] Terminate volume connection completed successfully. Apr 29 17:25:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-1b2db560-b330-4881-ad61-2ae0d6f7ca85 req-fc5e64b5-3988-4962-aeee-a875c13110b3 tempest-TestInstancesWithCinderVolumes-804517949 None] Deleting attachment 70f537bd-21c6-4f83-a2ba-756979c03ee5. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:25:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2580d17-5514-487c-952b-8bd878931eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3fbdf2b9-808f-40d2-a437-20ce3931f9ea', 'volume_name': 'volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3edd3adc-5ce5-418b-a8d9-4ea2e94f7d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3edd3adc-5ce5-418b-a8d9-4ea2e94f7d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf135b5-ce53-4787-bcde-f9eebcc87c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:14 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Volume 3fbdf2b9-808f-40d2-a437-20ce3931f9ea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 17:25:14 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Trying to clone 3fbdf2b9-808f-40d2-a437-20ce3931f9ea from image 982d68c3-05b9-445d-85e5-5c92642a92aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]). {{(pid=84547) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 17:25:14 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6d7a6299-c528-4f66-83cc-3deda079ae71 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd 1G" returned: 0 in 0.915s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6d7a6299-c528-4f66-83cc-3deda079ae71 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34831776-0134-4b32-9774-18057f4ad29d -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:14 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34831776-0134-4b32-9774-18057f4ad29d -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd Apr 29 17:25:14 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:15 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_n5beq_7odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 17:25:15 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Image download 20.69 MB at 20.69 MB/s Apr 29 17:25:15 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34cee58-3f4e-4a78-9ec7-a27a2348f9c7]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_n5beq_7odevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:15 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_n5beq_7odevstack@QuobyteHD Apr 29 17:25:15 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:15 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6d7a6299-c528-4f66-83cc-3deda079ae71 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34831776-0134-4b32-9774-18057f4ad29d -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd" returned: 0 in 0.838s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:15 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-6d7a6299-c528-4f66-83cc-3deda079ae71 tempest-VolumesDeleteCascade-1185488377 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd is being set with open permissions: ugo+rw Apr 29 17:25:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6d7a6299-c528-4f66-83cc-3deda079ae71 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:15 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd Apr 29 17:25:15 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:15 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_n5beq_7odevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:15 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Temporary image 982d68c3-05b9-445d-85e5-5c92642a92aa is fetched for user fed2314e56b041f094a8ebf1f5957504. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 17:25:15 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1970895-6ad7-461b-b9fd-5af5deffefcc]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_n5beq_7odevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:16 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_n5beq_7odevstack@QuobyteHD Apr 29 17:25:16 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:16 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6d7a6299-c528-4f66-83cc-3deda079ae71 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd" returned: 0 in 0.850s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:16 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] Acquiring lock "cinder-8e7e01e6-de6d-44bb-9ee4-4bd68a962265-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:16 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "cinder-8e7e01e6-de6d-44bb-9ee4-4bd68a962265-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6d7a6299-c528-4f66-83cc-3deda079ae71 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:16 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] Acquiring lock "cinder-quobyte-8e7e01e6-de6d-44bb-9ee4-4bd68a962265" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:16 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.info Apr 29 17:25:16 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:16 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "cinder-quobyte-8e7e01e6-de6d-44bb-9ee4-4bd68a962265" acquired by "delete_volume" :: waited 0.049s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:16 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6cc140-dcff-4f6b-bcab-5e3fdf01ca52]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8e7e01e6-de6d-44bb-9ee4-4bd68a962265 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:17 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8e7e01e6-de6d-44bb-9ee4-4bd68a962265 Apr 29 17:25:17 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:17 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_n5beq_7odevstack@QuobyteHD" returned: 0 in 1.422s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:18 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6d7a6299-c528-4f66-83cc-3deda079ae71 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.info" returned: 0 in 1.409s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:18 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-6d7a6299-c528-4f66-83cc-3deda079ae71 tempest-VolumesDeleteCascade-1185488377 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.info is being set with open permissions: ugo+rw Apr 29 17:25:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6d7a6299-c528-4f66-83cc-3deda079ae71 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:18 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.info Apr 29 17:25:18 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:18 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8e7e01e6-de6d-44bb-9ee4-4bd68a962265" returned: 0 in 1.389s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8e7e01e6-de6d-44bb-9ee4-4bd68a962265 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:18 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8e7e01e6-de6d-44bb-9ee4-4bd68a962265 Apr 29 17:25:18 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:18 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6d7a6299-c528-4f66-83cc-3deda079ae71 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.info" returned: 0 in 0.892s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6d7a6299-c528-4f66-83cc-3deda079ae71 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.026s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.622s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-201579126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fbdf2b9-808f-40d2-a437-20ce3931f9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd1f3bb543847dcbc5ef8fc962f31b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:25:14Z,use_quota=True,user_id='fed2314e56b041f094a8ebf1f5957504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:25:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Creating volume 3fbdf2b9-808f-40d2-a437-20ce3931f9ea {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:25:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:25:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:25:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:25:19 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:25:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:19 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea 1073741824 Apr 29 17:25:19 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:19 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8e7e01e6-de6d-44bb-9ee4-4bd68a962265" returned: 0 in 0.904s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:19 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-6d7a6299-c528-4f66-83cc-3deda079ae71 tempest-VolumesDeleteCascade-1185488377 None] Create snapshot completed successfully Apr 29 17:25:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "cinder-quobyte-8e7e01e6-de6d-44bb-9ee4-4bd68a962265" released by "delete_volume" :: held 2.396s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:19 devstack cinder-volume[84547]: WARNING cinder.quota [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-25240370-1628245905 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-25240370-1628245905, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:25:19 devstack cinder-volume[84547]: WARNING cinder.quota [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-25240370-1628245905 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-25240370-1628245905, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:25:19 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] Created reservations ['99fcb163-3345-4551-b4da-45b2dfa97a97', '2893167c-4a39-486f-b4b5-f59340a3d1d3', 'eeb0506b-2488-4028-9e5a-3dfd2d5e662e', '71320030-74c4-4839-b9aa-9feef4579c8e'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:25:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:25:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:25:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:19 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:25:19 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-868df0dd-c2f8-4aca-9c34-00e232bd0299 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:20 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea 1073741824" returned: 0 in 1.383s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:20 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.163s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:20 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:25:20 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea Apr 29 17:25:20 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] Deleted volume successfully. Apr 29 17:25:20 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-06a3dc5f-b896-447f-8dde-44ad72461dc6 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "cinder-8e7e01e6-de6d-44bb-9ee4-4bd68a962265-delete_volume" released by "delete_volume" :: held 3.949s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:21 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea" returned: 0 in 0.733s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] <== create_volume: return (2219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:25:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.227s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-868df0dd-c2f8-4aca-9c34-00e232bd0299 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.257s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-868df0dd-c2f8-4aca-9c34-00e232bd0299 tempest-VolumesDeleteCascade-1185488377 None] Creating offline snapshot 02371d96-6053-4d1f-95d3-860b654c2f71 of volume 34831776-0134-4b32-9774-18057f4ad29d {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:25:21 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d622baa0-906b-49ce-aaa6-416f4b06a6d3]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-868df0dd-c2f8-4aca-9c34-00e232bd0299 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:21 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Attempting download of 982d68c3-05b9-445d-85e5-5c92642a92aa ((None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}])) to volume 3fbdf2b9-808f-40d2-a437-20ce3931f9ea. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 17:25:21 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[2598fff3-4943-4762-8f0d-6306346d944e]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rws2bkhb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:21 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd Apr 29 17:25:21 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:21 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rws2bkhb Apr 29 17:25:21 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:22 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-868df0dd-c2f8-4aca-9c34-00e232bd0299 tempest-VolumesDeleteCascade-1185488377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd" returned: 0 in 0.991s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-868df0dd-c2f8-4aca-9c34-00e232bd0299 tempest-VolumesDeleteCascade-1185488377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34831776-0134-4b32-9774-18057f4ad29d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:25:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-868df0dd-c2f8-4aca-9c34-00e232bd0299 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.02371d96-6053-4d1f-95d3-860b654c2f71 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:22 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rws2bkhb" returned: 0 in 0.906s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rws2bkhb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:22 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.02371d96-6053-4d1f-95d3-860b654c2f71 1G Apr 29 17:25:22 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:22 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rws2bkhb Apr 29 17:25:22 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:23 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rws2bkhb" returned: 1 in 0.893s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_rws2bkhb' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:25:23 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[95721cd8-157c-4587-ada1-ed556b319e3a]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_n5beq_7odevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:23 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-5d1655b4-fbbc-4b33-8f6d-01532453e618 req-88100bd6-ed33-4133-85e2-59151b5730ff tempest-TestInstancesWithCinderVolumes-804517949 None] Terminate volume connection completed successfully. Apr 29 17:25:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-5d1655b4-fbbc-4b33-8f6d-01532453e618 req-88100bd6-ed33-4133-85e2-59151b5730ff tempest-TestInstancesWithCinderVolumes-804517949 None] Deleting attachment 12eed6f3-f1be-4f4e-b397-440a2fd294ba. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:25:23 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_n5beq_7odevstack@QuobyteHD Apr 29 17:25:23 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:23 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-868df0dd-c2f8-4aca-9c34-00e232bd0299 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.02371d96-6053-4d1f-95d3-860b654c2f71 1G" returned: 0 in 1.135s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-868df0dd-c2f8-4aca-9c34-00e232bd0299 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.02371d96-6053-4d1f-95d3-860b654c2f71 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:23 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.02371d96-6053-4d1f-95d3-860b654c2f71 Apr 29 17:25:23 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:24 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_n5beq_7odevstack@QuobyteHD" returned: 0 in 0.756s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:24 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] 982d68c3-05b9-445d-85e5-5c92642a92aa was qcow2, converting to raw {{(pid=84547) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 17:25:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_n5beq_7odevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:24 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_n5beq_7odevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea Apr 29 17:25:24 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:24 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-868df0dd-c2f8-4aca-9c34-00e232bd0299 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.02371d96-6053-4d1f-95d3-860b654c2f71" returned: 0 in 0.740s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:24 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-868df0dd-c2f8-4aca-9c34-00e232bd0299 tempest-VolumesDeleteCascade-1185488377 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.02371d96-6053-4d1f-95d3-860b654c2f71 is being set with open permissions: ugo+rw Apr 29 17:25:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-868df0dd-c2f8-4aca-9c34-00e232bd0299 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.02371d96-6053-4d1f-95d3-860b654c2f71 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:24 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.02371d96-6053-4d1f-95d3-860b654c2f71 Apr 29 17:25:24 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:24 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-868df0dd-c2f8-4aca-9c34-00e232bd0299 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.02371d96-6053-4d1f-95d3-860b654c2f71" returned: 0 in 0.686s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-868df0dd-c2f8-4aca-9c34-00e232bd0299 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.788s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:25 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-868df0dd-c2f8-4aca-9c34-00e232bd0299 tempest-VolumesDeleteCascade-1185488377 None] Create snapshot completed successfully Apr 29 17:25:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] Acquiring lock "cinder-024393cb-6b74-4858-ba4f-24821e62897d-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "cinder-024393cb-6b74-4858-ba4f-24821e62897d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] Acquiring lock "cinder-quobyte-024393cb-6b74-4858-ba4f-24821e62897d" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "cinder-quobyte-024393cb-6b74-4858-ba4f-24821e62897d" acquired by "delete_volume" :: waited 0.032s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:25 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89ee745-5b49-4143-9efb-e9730d8699e4]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-024393cb-6b74-4858-ba4f-24821e62897d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "cinder-34831776-0134-4b32-9774-18057f4ad29d-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-34831776-0134-4b32-9774-18057f4ad29d-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:25 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-024393cb-6b74-4858-ba4f-24821e62897d Apr 29 17:25:25 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:25 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Performing cascade delete. {{(pid=84547) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 29 17:25:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "cinder-02371d96-6053-4d1f-95d3-860b654c2f71-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-02371d96-6053-4d1f-95d3-860b654c2f71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "cinder-quobyte-34831776-0134-4b32-9774-18057f4ad29d" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-34831776-0134-4b32-9774-18057f4ad29d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "cinder-quobyte-02371d96-6053-4d1f-95d3-860b654c2f71" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-02371d96-6053-4d1f-95d3-860b654c2f71" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:25 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Deleting offline snapshot 02371d96-6053-4d1f-95d3-860b654c2f71 of volume 34831776-0134-4b32-9774-18057f4ad29d {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:25:25 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] snapshot_file for this snap is: volume-34831776-0134-4b32-9774-18057f4ad29d.02371d96-6053-4d1f-95d3-860b654c2f71 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:25:25 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e89548-f4b5-4f1e-8f83-a455f1231b9b]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.02371d96-6053-4d1f-95d3-860b654c2f71 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:25 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.02371d96-6053-4d1f-95d3-860b654c2f71 Apr 29 17:25:25 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:26 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_n5beq_7odevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea" returned: 0 in 2.637s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:26 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_n5beq_7odevstack@QuobyteHD, size 112.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:25:26 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Converted 112.00 MB image at 42.43 MB/s Apr 29 17:25:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:26 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea 1G Apr 29 17:25:26 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:26 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-024393cb-6b74-4858-ba4f-24821e62897d" returned: 0 in 1.532s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-024393cb-6b74-4858-ba4f-24821e62897d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:26 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-024393cb-6b74-4858-ba4f-24821e62897d Apr 29 17:25:26 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:26 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.02371d96-6053-4d1f-95d3-860b654c2f71" returned: 0 in 1.235s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34831776-0134-4b32-9774-18057f4ad29d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:25:27 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1409ea-158f-4046-b4dc-84d053eba319]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:27 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd Apr 29 17:25:27 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:27 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea 1G" returned: 0 in 1.195s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:27 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[752c8f6c-9663-473b-8b92-9254791aa3db]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:28 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-024393cb-6b74-4858-ba4f-24821e62897d" returned: 0 in 1.238s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "cinder-quobyte-024393cb-6b74-4858-ba4f-24821e62897d" released by "delete_volume" :: held 2.840s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:28 devstack cinder-volume[84547]: WARNING cinder.quota [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2029944768-792066189 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2029944768-792066189, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:25:28 devstack cinder-volume[84547]: WARNING cinder.quota [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2029944768-792066189 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2029944768-792066189, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:25:28 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea Apr 29 17:25:28 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] Created reservations ['970348b3-586c-45ea-a994-3c5896f2d522', 'bf8f1a0a-4c29-4a10-87af-e1e54e169a7d', '291f286c-161c-4f8f-a4e5-8033f2fbc4e4', '96776fa9-7ef3-4153-9c18-08a65fe9cf38'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:25:28 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:25:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:25:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:28 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:25:28 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:28 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd" returned: 0 in 1.559s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34831776-0134-4b32-9774-18057f4ad29d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:25:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.02371d96-6053-4d1f-95d3-860b654c2f71 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:28 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.02371d96-6053-4d1f-95d3-860b654c2f71 Apr 29 17:25:28 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:29 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea" returned: 0 in 1.465s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:29 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea Apr 29 17:25:29 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:29 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.394s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:29 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:25:29 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] Deleted volume successfully. Apr 29 17:25:29 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8a0450f2-9b6c-4f7f-94c7-f0a43bfcb7a9 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "cinder-024393cb-6b74-4858-ba4f-24821e62897d-delete_volume" released by "delete_volume" :: held 4.658s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:30 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.02371d96-6053-4d1f-95d3-860b654c2f71" returned: 0 in 1.496s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.02371d96-6053-4d1f-95d3-860b654c2f71 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:30 devstack sudo[103416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.02371d96-6053-4d1f-95d3-860b654c2f71 Apr 29 17:25:30 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:30 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea" returned: 1 in 1.146s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:25:30 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Downloaded image 982d68c3-05b9-445d-85e5-5c92642a92aa ((None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}])) to volume 3fbdf2b9-808f-40d2-a437-20ce3931f9ea successfully. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 17:25:30 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Temporary image 982d68c3-05b9-445d-85e5-5c92642a92aa for user fed2314e56b041f094a8ebf1f5957504 is deleted. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 17:25:30 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Marking volume 3fbdf2b9-808f-40d2-a437-20ce3931f9ea as bootable. {{(pid=84547) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 17:25:30 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Copying metadata from image 982d68c3-05b9-445d-85e5-5c92642a92aa to 3fbdf2b9-808f-40d2-a437-20ce3931f9ea. {{(pid=84547) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 17:25:30 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Creating volume glance metadata for volume 3fbdf2b9-808f-40d2-a437-20ce3931f9ea backed by image 982d68c3-05b9-445d-85e5-5c92642a92aa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84547) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 17:25:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf135b5-ce53-4787-bcde-f9eebcc87c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5909e59b-6a2e-4483-aae8-2f0dce63a7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:30 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Volume volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea (3fbdf2b9-808f-40d2-a437-20ce3931f9ea): created successfully Apr 29 17:25:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5909e59b-6a2e-4483-aae8-2f0dce63a7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Flow 'volume_create_manager' (9d0f5cbd-4bea-49fa-b68c-1c46535a3c7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:25:30 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d4903431-1049-490d-9bf2-c054e1067e17 tempest-VolumesExtendTest-421846900 None] Created volume successfully. Apr 29 17:25:31 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.02371d96-6053-4d1f-95d3-860b654c2f71" returned: 0 in 0.952s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-02371d96-6053-4d1f-95d3-860b654c2f71" released by "_delete_snapshot" :: held 5.416s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-34831776-0134-4b32-9774-18057f4ad29d" released by "delete_snapshot" :: held 5.450s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:31 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Created reservations ['8fd92522-617d-4de7-8b99-b36e10f4c3c2', 'd63aa1d4-c54a-41f5-bec0-e44c2e5020f0', 'baea9e6e-270a-4f06-b987-752802ed6150', 'd15aca10-7a9e-49d9-b210-6687dba6922a'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:25:31 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Delete snapshot completed successfully. Apr 29 17:25:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-02371d96-6053-4d1f-95d3-860b654c2f71-delete_snapshot" released by "delete_snapshot" :: held 5.673s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "cinder-3b804098-c68d-4c88-a370-e70c6fbe1bdd-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-3b804098-c68d-4c88-a370-e70c6fbe1bdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "cinder-quobyte-34831776-0134-4b32-9774-18057f4ad29d" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-34831776-0134-4b32-9774-18057f4ad29d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "cinder-quobyte-3b804098-c68d-4c88-a370-e70c6fbe1bdd" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-3b804098-c68d-4c88-a370-e70c6fbe1bdd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Deleting offline snapshot 3b804098-c68d-4c88-a370-e70c6fbe1bdd of volume 34831776-0134-4b32-9774-18057f4ad29d {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:25:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] snapshot_file for this snap is: volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:25:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0fff8415-55b6-4e54-9ebe-a149b75506b0 tempest-VolumesExtendTest-421846900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0fff8415-55b6-4e54-9ebe-a149b75506b0 tempest-VolumesExtendTest-421846900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:31 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b133695f-d0f4-482e-bf5d-951512574541]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:31 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc22d28e-dca2-4b17-abb4-4aa13be342ec]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0fff8415-55b6-4e54-9ebe-a149b75506b0 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:31 devstack sudo[103472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd Apr 29 17:25:31 devstack sudo[103472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:31 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea Apr 29 17:25:31 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:32 devstack sudo[103472]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd" returned: 0 in 0.889s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34831776-0134-4b32-9774-18057f4ad29d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:25:32 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:32 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b50766-8d7c-4231-813d-767dea520923]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0fff8415-55b6-4e54-9ebe-a149b75506b0 tempest-VolumesExtendTest-421846900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea" returned: 0 in 0.922s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0fff8415-55b6-4e54-9ebe-a149b75506b0 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:32 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d Apr 29 17:25:32 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:32 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea Apr 29 17:25:32 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:33 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0fff8415-55b6-4e54-9ebe-a149b75506b0 tempest-VolumesExtendTest-421846900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea" returned: 1 in 0.749s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0fff8415-55b6-4e54-9ebe-a149b75506b0 tempest-VolumesExtendTest-421846900 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:25:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0fff8415-55b6-4e54-9ebe-a149b75506b0 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea 2G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:33 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d" returned: 0 in 0.789s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:33 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd Apr 29 17:25:33 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0fff8415-55b6-4e54-9ebe-a149b75506b0 tempest-VolumesExtendTest-421846900 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea 2G" returned: 0 in 0.098s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0fff8415-55b6-4e54-9ebe-a149b75506b0 tempest-VolumesExtendTest-421846900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.828s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:33 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-0fff8415-55b6-4e54-9ebe-a149b75506b0 tempest-VolumesExtendTest-421846900 None] Extend volume completed successfully. Apr 29 17:25:33 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] Acquiring lock "cinder-3fbdf2b9-808f-40d2-a437-20ce3931f9ea-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:33 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] Lock "cinder-3fbdf2b9-808f-40d2-a437-20ce3931f9ea-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:33 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=108,cinder:INSERT=30,cinder:UPDATE=109,cinder:DELETE=11 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:25:33 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-c371402b-aae6-43ef-ad57-fbf91e85795b req-1d5ad9a5-d7fd-4f25-add5-b5852f48f83d tempest-TestInstancesWithCinderVolumes-804517949 None] Terminate volume connection completed successfully. Apr 29 17:25:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-c371402b-aae6-43ef-ad57-fbf91e85795b req-1d5ad9a5-d7fd-4f25-add5-b5852f48f83d tempest-TestInstancesWithCinderVolumes-804517949 None] Deleting attachment f0057a3b-2b8c-45f8-bcdb-d6785116d724. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:25:33 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] Acquiring lock "cinder-quobyte-3fbdf2b9-808f-40d2-a437-20ce3931f9ea" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:33 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] Lock "cinder-quobyte-3fbdf2b9-808f-40d2-a437-20ce3931f9ea" acquired by "delete_volume" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:33 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0986b04-1507-41dc-9e5a-b8d985adfac0]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:33 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd" returned: 0 in 0.812s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:34 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd Apr 29 17:25:34 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:34 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea Apr 29 17:25:34 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:34 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d.3b804098-c68d-4c88-a370-e70c6fbe1bdd" returned: 0 in 0.604s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-3b804098-c68d-4c88-a370-e70c6fbe1bdd" released by "_delete_snapshot" :: held 3.242s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-34831776-0134-4b32-9774-18057f4ad29d" released by "delete_snapshot" :: held 3.272s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:34 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea" returned: 0 in 0.717s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:34 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=92,cinder:INSERT=32,cinder:UPDATE=106,cinder:DELETE=7 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:25:34 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Created reservations ['082ab698-c0d8-4b5a-9c6e-4ab5363344a7', '719d2200-3519-4305-81e7-327305d5a322', 'f275293a-a99a-4574-9bf5-b761bd2cc41d', '10282725-7508-4f5b-ba25-f96a2d22e03a'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:25:34 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea Apr 29 17:25:34 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:34 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Delete snapshot completed successfully. Apr 29 17:25:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-3b804098-c68d-4c88-a370-e70c6fbe1bdd-delete_snapshot" released by "delete_snapshot" :: held 3.467s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:34 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Snapshots deleted, issuing volume delete {{(pid=84547) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 29 17:25:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "cinder-quobyte-34831776-0134-4b32-9774-18057f4ad29d" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-34831776-0134-4b32-9774-18057f4ad29d" acquired by "delete_volume" :: waited 0.013s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:34 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e498353-6546-44f3-b57a-5c3510843e27]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:34 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d Apr 29 17:25:34 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:35 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea" returned: 1 in 0.747s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:25:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:35 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea Apr 29 17:25:35 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:35 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d" returned: 0 in 0.763s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:35 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d Apr 29 17:25:35 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:36 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3fbdf2b9-808f-40d2-a437-20ce3931f9ea" returned: 0 in 0.616s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] Lock "cinder-quobyte-3fbdf2b9-808f-40d2-a437-20ce3931f9ea" released by "delete_volume" :: held 2.168s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] Created reservations ['32e38158-2a65-41f5-9fe1-2625d3b7e6a9', 'fb772be7-4b21-4d9c-bb42-abc764125ab9', '33d6e5ae-afad-409a-a0b2-89423f6d8980', '97011063-1ed4-43e1-9d6c-cf2af3fc2945'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:36 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:25:36 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:36 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34831776-0134-4b32-9774-18057f4ad29d" returned: 0 in 0.646s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-34831776-0134-4b32-9774-18057f4ad29d" released by "delete_volume" :: held 1.470s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Created reservations ['264817f4-42ba-40b0-882e-5cda43481670', '486b8248-a57d-4ade-bb19-c4a9b9317d77', 'e82c54b4-0f60-41c6-9383-fb61e4635668', '7eb1bf1e-05c0-4b06-8f1b-8d1df474b3ef'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:36 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:25:36 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:36 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.737s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:25:36 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] Deleted volume successfully. Apr 29 17:25:36 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad7a0950-d5c6-4b4e-bea1-30f627b5552e tempest-VolumesExtendTest-421846900 None] Lock "cinder-3fbdf2b9-808f-40d2-a437-20ce3931f9ea-delete_volume" released by "delete_volume" :: held 3.143s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Flow 'volume_create_manager' (5d30885a-99a4-4747-a747-41f188c85faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a9f634-2513-427d-abf2-788b18a7bdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a9f634-2513-427d-abf2-788b18a7bdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-923008426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43810c29-4c2a-4de4-a8df-5ce9a4457951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca954909de904fb58ea4e76b05802cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:25:37Z,use_quota=True,user_id='fcd073b0670446ff9a6c23ed884e6d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58525e77-ad48-4ae1-a9d3-ea254bfb4f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58525e77-ad48-4ae1-a9d3-ea254bfb4f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dba3db3-fb0e-4605-8417-e58d52f8287c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dba3db3-fb0e-4605-8417-e58d52f8287c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43810c29-4c2a-4de4-a8df-5ce9a4457951', 'volume_name': 'volume-43810c29-4c2a-4de4-a8df-5ce9a4457951', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4035248-d0b6-4f8a-be05-e1db71cf31d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4035248-d0b6-4f8a-be05-e1db71cf31d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dcc60a0-25c2-41dc-a07d-35e145a35442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:37 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:37 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Volume 43810c29-4c2a-4de4-a8df-5ce9a4457951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43810c29-4c2a-4de4-a8df-5ce9a4457951', 'volume_size': 1} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-923008426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43810c29-4c2a-4de4-a8df-5ce9a4457951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca954909de904fb58ea4e76b05802cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:25:37Z,use_quota=True,user_id='fcd073b0670446ff9a6c23ed884e6d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Creating volume 43810c29-4c2a-4de4-a8df-5ce9a4457951 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:25:37 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.104s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:25:37 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Deleted volume successfully. Apr 29 17:25:37 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 1073741824 Apr 29 17:25:37 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5ec8e8ab-fbd2-4b07-b70b-db86ae569c30 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-34831776-0134-4b32-9774-18057f4ad29d-delete_volume" released by "delete_volume" :: held 12.097s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] Acquiring lock "cinder-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "cinder-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] Acquiring lock "cinder-quobyte-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "cinder-quobyte-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c" acquired by "delete_volume" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff6d635-c467-432c-ab9f-cf35f9fd4a15]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Flow 'volume_create_manager' (e211f0a0-76f0-498a-a23a-b387bb7acdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd001c32-e392-42bf-81c5-04076400c930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd001c32-e392-42bf-81c5-04076400c930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1077942815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa3f8ed-b9ef-417d-a61f-202bc76479c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd1f3bb543847dcbc5ef8fc962f31b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:25:38Z,use_quota=True,user_id='fed2314e56b041f094a8ebf1f5957504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (440afda3-f7e9-4a9e-b0ee-d8e9bb1e7a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (440afda3-f7e9-4a9e-b0ee-d8e9bb1e7a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef669f11-9282-442a-a693-efc4f5f6e9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef669f11-9282-442a-a693-efc4f5f6e9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efa3f8ed-b9ef-417d-a61f-202bc76479c2', 'volume_name': 'volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb7505f-95d3-496d-8fed-c5bec4b8e37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb7505f-95d3-496d-8fed-c5bec4b8e37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f425d740-78d3-4059-a066-3761f5b555ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:37 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Volume efa3f8ed-b9ef-417d-a61f-202bc76479c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2', 'volume_size': 1} Apr 29 17:25:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:37 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c Apr 29 17:25:37 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:38 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 1073741824" returned: 0 in 1.048s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:38 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c" returned: 0 in 0.752s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:38 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 Apr 29 17:25:38 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:38 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c Apr 29 17:25:38 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:39 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951" returned: 0 in 0.598s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.225s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1077942815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa3f8ed-b9ef-417d-a61f-202bc76479c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cd1f3bb543847dcbc5ef8fc962f31b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:25:38Z,use_quota=True,user_id='fed2314e56b041f094a8ebf1f5957504',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Creating volume efa3f8ed-b9ef-417d-a61f-202bc76479c2 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:25:39 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dcc60a0-25c2-41dc-a07d-35e145a35442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43810c29-4c2a-4de4-a8df-5ce9a4457951', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a420fa-6fd6-4cab-8eb3-251e5e284ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:39 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2 1073741824 Apr 29 17:25:39 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:39 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Volume volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 (43810c29-4c2a-4de4-a8df-5ce9a4457951): created successfully Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a420fa-6fd6-4cab-8eb3-251e5e284ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Flow 'volume_create_manager' (5d30885a-99a4-4747-a747-41f188c85faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:25:39 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d00ce873-c0a6-4dc4-9810-2e1d12694931 tempest-VolumesDeleteCascade-1185488377 None] Created volume successfully. Apr 29 17:25:39 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c" returned: 1 in 0.726s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:39 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c Apr 29 17:25:39 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d482f68d-0264-4aaa-a55d-150db849ef6c tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:39 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c" returned: 0 in 0.610s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:39 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "cinder-quobyte-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c" released by "delete_volume" :: held 2.172s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:39 devstack cinder-volume[84547]: WARNING cinder.quota [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-21550693-1707422306 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-21550693-1707422306, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:25:39 devstack cinder-volume[84547]: WARNING cinder.quota [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-21550693-1707422306 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-21550693-1707422306, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] Created reservations ['23dc8eb5-92d4-46a7-8c7d-6a2039f7617b', '8826171f-d3bc-4c65-90e8-0fa6f2ce6dd5', '5527d214-2551-4f09-831a-9d408a9dd3a9', '0e87c99b-f583-4741-9f58-4a1dc5b8a3f6'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:25:40 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2 1073741824" returned: 0 in 0.826s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:40 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2 Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:40 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:40 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:25:40 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:40 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2" returned: 0 in 0.588s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d482f68d-0264-4aaa-a55d-150db849ef6c tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.088s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-d482f68d-0264-4aaa-a55d-150db849ef6c tempest-VolumesDeleteCascade-1185488377 None] Creating offline snapshot 8b1883dc-61eb-4b63-b8d8-710274849634 of volume 43810c29-4c2a-4de4-a8df-5ce9a4457951 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f425d740-78d3-4059-a066-3761f5b555ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db26e629-efc0-4e1a-a9b1-d2eb4354ce63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f0eaed-555f-4e5b-befe-fb88436c34dd]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d482f68d-0264-4aaa-a55d-150db849ef6c tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:40 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Volume volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2 (efa3f8ed-b9ef-417d-a61f-202bc76479c2): created successfully Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db26e629-efc0-4e1a-a9b1-d2eb4354ce63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Flow 'volume_create_manager' (e211f0a0-76f0-498a-a23a-b387bb7acdba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:25:40 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-af3315c3-8a63-4cec-b69c-dcfd4b5eacf8 tempest-VolumesExtendTest-421846900 None] Created volume successfully. Apr 29 17:25:40 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.659s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:25:40 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] Deleted volume successfully. Apr 29 17:25:40 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-14f38bc0-b4b8-4c58-9d50-47c5917d6465 tempest-TestInstancesWithCinderVolumes-804517949 None] Lock "cinder-a6abc3a8-516b-45a0-a1e6-0e04b810ea0c-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:25:40 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 Apr 29 17:25:40 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bb43b1e6-cb0a-4e7a-a887-f984e2188430 tempest-VolumesExtendTest-421846900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:41 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d482f68d-0264-4aaa-a55d-150db849ef6c tempest-VolumesDeleteCascade-1185488377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951" returned: 0 in 0.819s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d482f68d-0264-4aaa-a55d-150db849ef6c tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:41 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634 1G Apr 29 17:25:41 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:42 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:25:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Flow 'volume_create_manager' (a248ef5f-1ddc-4db6-a169-fed07415910c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:25:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d203e0d1-ac12-4fbe-8ebb-1f2f8712d922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d203e0d1-ac12-4fbe-8ebb-1f2f8712d922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1240982555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c726da-8788-4c37-9172-d19dfd93ce91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9058d75fb82f4f658e87a3705c475e4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:25:42Z,use_quota=True,user_id='0ae5dab6d01b4afc88524345688f8c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006b03fc-a5f1-4a62-9263-5b86e35bde8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (006b03fc-a5f1-4a62-9263-5b86e35bde8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17287ab-849e-4c27-9118-7209f708d76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17287ab-849e-4c27-9118-7209f708d76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11c726da-8788-4c37-9172-d19dfd93ce91', 'volume_name': 'volume-11c726da-8788-4c37-9172-d19dfd93ce91', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (996a79d0-b678-43d6-8f3c-042e512d56df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (996a79d0-b678-43d6-8f3c-042e512d56df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16002bb8-34c1-421f-90a4-1ad349c0bd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:42 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Volume 11c726da-8788-4c37-9172-d19dfd93ce91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11c726da-8788-4c37-9172-d19dfd93ce91', 'volume_size': 1} Apr 29 17:25:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:42 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d482f68d-0264-4aaa-a55d-150db849ef6c tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634 1G" returned: 0 in 0.872s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d482f68d-0264-4aaa-a55d-150db849ef6c tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:42 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634 Apr 29 17:25:42 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:43 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d482f68d-0264-4aaa-a55d-150db849ef6c tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634" returned: 0 in 0.672s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:43 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-d482f68d-0264-4aaa-a55d-150db849ef6c tempest-VolumesDeleteCascade-1185488377 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634 is being set with open permissions: ugo+rw Apr 29 17:25:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d482f68d-0264-4aaa-a55d-150db849ef6c tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:43 devstack sudo[103583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634 Apr 29 17:25:43 devstack sudo[103583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:43 devstack sudo[103583]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d482f68d-0264-4aaa-a55d-150db849ef6c tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634" returned: 0 in 0.632s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d482f68d-0264-4aaa-a55d-150db849ef6c tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:43 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.info Apr 29 17:25:43 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:44 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d482f68d-0264-4aaa-a55d-150db849ef6c tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.info" returned: 0 in 0.648s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:44 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-d482f68d-0264-4aaa-a55d-150db849ef6c tempest-VolumesDeleteCascade-1185488377 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.info is being set with open permissions: ugo+rw Apr 29 17:25:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d482f68d-0264-4aaa-a55d-150db849ef6c tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:44 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.info Apr 29 17:25:44 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:45 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d482f68d-0264-4aaa-a55d-150db849ef6c tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.info" returned: 0 in 0.682s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d482f68d-0264-4aaa-a55d-150db849ef6c tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.433s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bb43b1e6-cb0a-4e7a-a887-f984e2188430 tempest-VolumesExtendTest-421846900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.809s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-bb43b1e6-cb0a-4e7a-a887-f984e2188430 tempest-VolumesExtendTest-421846900 None] Creating offline snapshot 864e455f-8b7d-4457-bf80-456d95fa54ab of volume efa3f8ed-b9ef-417d-a61f-202bc76479c2 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:25:45 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d482f68d-0264-4aaa-a55d-150db849ef6c tempest-VolumesDeleteCascade-1185488377 None] Create snapshot completed successfully Apr 29 17:25:45 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[55908cf4-128d-4acb-bf21-ebcd3dbc588d]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bb43b1e6-cb0a-4e7a-a887-f984e2188430 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:45 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2 Apr 29 17:25:45 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:45 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bb43b1e6-cb0a-4e7a-a887-f984e2188430 tempest-VolumesExtendTest-421846900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2" returned: 0 in 0.757s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bb43b1e6-cb0a-4e7a-a887-f984e2188430 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:45 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab 1G Apr 29 17:25:45 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:46 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:25:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Flow 'volume_create_manager' (1c5a8d36-8408-4510-9e5a-1fbcdf2cf301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:25:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a65aa1cd-eb61-4306-86f5-f3c0b53977a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a65aa1cd-eb61-4306-86f5-f3c0b53977a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1721531693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c98f4f4a-3937-44fd-ae04-dacdff7194b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca954909de904fb58ea4e76b05802cea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8b1883dc-61eb-4b63-b8d8-710274849634,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:25:46Z,use_quota=True,user_id='fcd073b0670446ff9a6c23ed884e6d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c39a71ba-a3ef-4617-abb3-906a9eb3934f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c39a71ba-a3ef-4617-abb3-906a9eb3934f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906eec75-c206-45ae-8401-99bc4f682be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906eec75-c206-45ae-8401-99bc4f682be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c98f4f4a-3937-44fd-ae04-dacdff7194b8', 'volume_name': 'volume-c98f4f4a-3937-44fd-ae04-dacdff7194b8', 'volume_size': 1, 'snapshot_id': '8b1883dc-61eb-4b63-b8d8-710274849634'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec456bc7-9a00-45c1-8596-3e5a951b7ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec456bc7-9a00-45c1-8596-3e5a951b7ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b684c73d-8ca8-4e9a-ba6d-0cf6e2099f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:46 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Volume c98f4f4a-3937-44fd-ae04-dacdff7194b8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c98f4f4a-3937-44fd-ae04-dacdff7194b8', 'volume_size': 1, 'snapshot_id': '8b1883dc-61eb-4b63-b8d8-710274849634'} Apr 29 17:25:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:46 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bb43b1e6-cb0a-4e7a-a887-f984e2188430 tempest-VolumesExtendTest-421846900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab 1G" returned: 0 in 0.900s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bb43b1e6-cb0a-4e7a-a887-f984e2188430 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:46 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab Apr 29 17:25:46 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:47 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bb43b1e6-cb0a-4e7a-a887-f984e2188430 tempest-VolumesExtendTest-421846900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab" returned: 0 in 0.704s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:47 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-bb43b1e6-cb0a-4e7a-a887-f984e2188430 tempest-VolumesExtendTest-421846900 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab is being set with open permissions: ugo+rw Apr 29 17:25:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bb43b1e6-cb0a-4e7a-a887-f984e2188430 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:47 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab Apr 29 17:25:47 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:48 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bb43b1e6-cb0a-4e7a-a887-f984e2188430 tempest-VolumesExtendTest-421846900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab" returned: 0 in 0.601s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bb43b1e6-cb0a-4e7a-a887-f984e2188430 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:48 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.info Apr 29 17:25:48 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:48 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bb43b1e6-cb0a-4e7a-a887-f984e2188430 tempest-VolumesExtendTest-421846900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.info" returned: 0 in 0.681s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:48 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-bb43b1e6-cb0a-4e7a-a887-f984e2188430 tempest-VolumesExtendTest-421846900 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.info is being set with open permissions: ugo+rw Apr 29 17:25:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bb43b1e6-cb0a-4e7a-a887-f984e2188430 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:48 devstack sudo[103618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.info Apr 29 17:25:48 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:49 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bb43b1e6-cb0a-4e7a-a887-f984e2188430 tempest-VolumesExtendTest-421846900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.info" returned: 0 in 0.646s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bb43b1e6-cb0a-4e7a-a887-f984e2188430 tempest-VolumesExtendTest-421846900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.460s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.466s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:49 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1240982555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11c726da-8788-4c37-9172-d19dfd93ce91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9058d75fb82f4f658e87a3705c475e4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:25:42Z,use_quota=True,user_id='0ae5dab6d01b4afc88524345688f8c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:25:49 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Creating volume 11c726da-8788-4c37-9172-d19dfd93ce91 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:25:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:49 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:25:49 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:25:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:49 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:25:49 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:25:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-11c726da-8788-4c37-9172-d19dfd93ce91 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:49 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-11c726da-8788-4c37-9172-d19dfd93ce91 1073741824 Apr 29 17:25:49 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:49 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-bb43b1e6-cb0a-4e7a-a887-f984e2188430 tempest-VolumesExtendTest-421846900 None] Create snapshot completed successfully Apr 29 17:25:50 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-11c726da-8788-4c37-9172-d19dfd93ce91 1073741824" returned: 0 in 0.860s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-11c726da-8788-4c37-9172-d19dfd93ce91 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:50 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-11c726da-8788-4c37-9172-d19dfd93ce91 Apr 29 17:25:50 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-25d893c3-9665-45ac-8142-3bbf16a37a43 tempest-VolumesExtendTest-421846900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:51 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-11c726da-8788-4c37-9172-d19dfd93ce91" returned: 0 in 0.676s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.622s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "cinder-quobyte-8b1883dc-61eb-4b63-b8d8-710274849634-c98f4f4a-3937-44fd-ae04-dacdff7194b8" by "_create_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16002bb8-34c1-421f-90a4-1ad349c0bd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11c726da-8788-4c37-9172-d19dfd93ce91', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105bb9fa-74ce-47d4-b5bc-141328c7dbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-8b1883dc-61eb-4b63-b8d8-710274849634-c98f4f4a-3937-44fd-ae04-dacdff7194b8" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Creating volume c98f4f4a-3937-44fd-ae04-dacdff7194b8 from snapshot 8b1883dc-61eb-4b63-b8d8-710274849634 {{(pid=84547) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "cinder-quobyte-c98f4f4a-3937-44fd-ae04-dacdff7194b8" by "_copy_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:25:51 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Volume volume-11c726da-8788-4c37-9172-d19dfd93ce91 (11c726da-8788-4c37-9172-d19dfd93ce91): created successfully Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105bb9fa-74ce-47d4-b5bc-141328c7dbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Flow 'volume_create_manager' (a248ef5f-1ddc-4db6-a169-fed07415910c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-c98f4f4a-3937-44fd-ae04-dacdff7194b8" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] snapshot: 8b1883dc-61eb-4b63-b8d8-710274849634, volume: c98f4f4a-3937-44fd-ae04-dacdff7194b8, {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 17:25:51 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-c29567be-6b93-4cc0-a094-b4f3aeb4793d tempest-AttachVolumeNegativeTest-698092894 None] Created volume successfully. Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f60e15-2502-4a25-9862-789891310b1f]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:51 devstack sudo[103631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634 Apr 29 17:25:51 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:52 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634" returned: 0 in 0.796s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43810c29-4c2a-4de4-a8df-5ce9a4457951(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:25:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 17:25:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Creating direct copy from snapshot {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 17:25:52 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d09a93-e07e-41d9-bcbe-0aaf4f4ad7d5]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:52 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 Apr 29 17:25:52 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:52 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951" returned: 0 in 0.815s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:52 devstack cinder-volume[84547]: DEBUG cinder.utils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Path /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c98f4f4a-3937-44fd-ae04-dacdff7194b8 not found in is_blk_device check {{(pid=84547) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 17:25:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c98f4f4a-3937-44fd-ae04-dacdff7194b8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:52 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c98f4f4a-3937-44fd-ae04-dacdff7194b8 Apr 29 17:25:52 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:25:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-4605641f-2096-444f-833e-d977fa6545ae req-ac655fba-f332-4459-bb45-2be37e264330 tempest-AttachVolumeNegativeTest-698092894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:25:59 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Apr 29 17:25:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c98f4f4a-3937-44fd-ae04-dacdff7194b8" returned: 0 in 6.360s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:25:59 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa7dbe9-f8ba-4239-a84a-3a517aa6d44f]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:25:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:25:59 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 Apr 29 17:25:59 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:00 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951" returned: 0 in 1.054s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:00 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951, size 1024.00 MB, duration 6.36 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c98f4f4a-3937-44fd-ae04-dacdff7194b8 {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:26:00 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Converted 1024.00 MB image at 160.98 MB/s Apr 29 17:26:00 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c98f4f4a-3937-44fd-ae04-dacdff7194b8 is being set with open permissions: ugo+rw Apr 29 17:26:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c98f4f4a-3937-44fd-ae04-dacdff7194b8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:00 devstack sudo[103718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c98f4f4a-3937-44fd-ae04-dacdff7194b8 Apr 29 17:26:00 devstack sudo[103718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:00 devstack sudo[103718]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c98f4f4a-3937-44fd-ae04-dacdff7194b8" returned: 0 in 0.615s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-c98f4f4a-3937-44fd-ae04-dacdff7194b8" released by "_copy_volume_from_snapshot" :: held 9.768s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-8b1883dc-61eb-4b63-b8d8-710274849634-c98f4f4a-3937-44fd-ae04-dacdff7194b8" released by "_create_volume_from_snapshot" :: held 9.820s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.857s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-25d893c3-9665-45ac-8142-3bbf16a37a43 tempest-VolumesExtendTest-421846900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 10.255s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:01 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d02621-50b3-43d1-b0be-4263457cfb29]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:26:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-25d893c3-9665-45ac-8142-3bbf16a37a43 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b684c73d-8ca8-4e9a-ba6d-0cf6e2099f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c98f4f4a-3937-44fd-ae04-dacdff7194b8', 'volume_size': 1, 'snapshot_id': '8b1883dc-61eb-4b63-b8d8-710274849634'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d996c0-8626-40b5-b449-32642f6de58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:01 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Volume volume-c98f4f4a-3937-44fd-ae04-dacdff7194b8 (c98f4f4a-3937-44fd-ae04-dacdff7194b8): created successfully Apr 29 17:26:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d996c0-8626-40b5-b449-32642f6de58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Flow 'volume_create_manager' (1c5a8d36-8408-4510-9e5a-1fbcdf2cf301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:26:01 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-c6fb8388-2c45-44d7-8cf0-11911300c3c3 tempest-VolumesDeleteCascade-1185488377 None] Created volume successfully. Apr 29 17:26:01 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2 Apr 29 17:26:01 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:01 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-25d893c3-9665-45ac-8142-3bbf16a37a43 tempest-VolumesExtendTest-421846900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2" returned: 0 in 0.727s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-25d893c3-9665-45ac-8142-3bbf16a37a43 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab 2G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-25d893c3-9665-45ac-8142-3bbf16a37a43 tempest-VolumesExtendTest-421846900 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab 2G" returned: 0 in 0.177s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-25d893c3-9665-45ac-8142-3bbf16a37a43 tempest-VolumesExtendTest-421846900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.943s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-4605641f-2096-444f-833e-d977fa6545ae req-ac655fba-f332-4459-bb45-2be37e264330 tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.416s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:01 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[87aca61c-92c0-4843-92db-137ad0993f9f]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:26:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-4605641f-2096-444f-833e-d977fa6545ae req-ac655fba-f332-4459-bb45-2be37e264330 tempest-AttachVolumeNegativeTest-698092894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-11c726da-8788-4c37-9172-d19dfd93ce91 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:02 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-25d893c3-9665-45ac-8142-3bbf16a37a43 tempest-VolumesExtendTest-421846900 None] Extend volume completed successfully. Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "cinder-43810c29-4c2a-4de4-a8df-5ce9a4457951-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-43810c29-4c2a-4de4-a8df-5ce9a4457951-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:02 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-11c726da-8788-4c37-9172-d19dfd93ce91 Apr 29 17:26:02 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Performing cascade delete. {{(pid=84547) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "cinder-8b1883dc-61eb-4b63-b8d8-710274849634-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-8b1883dc-61eb-4b63-b8d8-710274849634-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "cinder-quobyte-43810c29-4c2a-4de4-a8df-5ce9a4457951" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-43810c29-4c2a-4de4-a8df-5ce9a4457951" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "cinder-quobyte-8b1883dc-61eb-4b63-b8d8-710274849634" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-8b1883dc-61eb-4b63-b8d8-710274849634" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Deleting offline snapshot 8b1883dc-61eb-4b63-b8d8-710274849634 of volume 43810c29-4c2a-4de4-a8df-5ce9a4457951 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] snapshot_file for this snap is: volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fa7155-5982-4b6f-945a-86b52d185164]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] Acquiring lock "cinder-864e455f-8b7d-4457-bf80-456d95fa54ab-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] Lock "cinder-864e455f-8b7d-4457-bf80-456d95fa54ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] Acquiring lock "cinder-quobyte-efa3f8ed-b9ef-417d-a61f-202bc76479c2" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] Lock "cinder-quobyte-efa3f8ed-b9ef-417d-a61f-202bc76479c2" acquired by "delete_snapshot" :: waited 0.037s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] Acquiring lock "cinder-quobyte-864e455f-8b7d-4457-bf80-456d95fa54ab" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] Lock "cinder-quobyte-864e455f-8b7d-4457-bf80-456d95fa54ab" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] Deleting offline snapshot 864e455f-8b7d-4457-bf80-456d95fa54ab of volume efa3f8ed-b9ef-417d-a61f-202bc76479c2 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] snapshot_file for this snap is: volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[80190ce4-ae31-424b-b733-34a1f9b03658]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:26:02 devstack sudo[103732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634 Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:02 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:02 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab Apr 29 17:26:02 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:02 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-4605641f-2096-444f-833e-d977fa6545ae req-ac655fba-f332-4459-bb45-2be37e264330 tempest-AttachVolumeNegativeTest-698092894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-11c726da-8788-4c37-9172-d19dfd93ce91" returned: 0 in 0.935s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-4605641f-2096-444f-833e-d977fa6545ae req-ac655fba-f332-4459-bb45-2be37e264330 tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.967s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-4605641f-2096-444f-833e-d977fa6545ae req-ac655fba-f332-4459-bb45-2be37e264330 tempest-AttachVolumeNegativeTest-698092894 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-11c726da-8788-4c37-9172-d19dfd93ce91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ece11202-8bb9-4d30-a81c-24a2358c5f05', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:26:03 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-4605641f-2096-444f-833e-d977fa6545ae req-ac655fba-f332-4459-bb45-2be37e264330 tempest-AttachVolumeNegativeTest-698092894 None] attachment_update completed successfully. Apr 29 17:26:03 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634" returned: 0 in 0.995s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43810c29-4c2a-4de4-a8df-5ce9a4457951(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:26:03 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de119c1-a54e-4516-9b2c-dd5d2c206bd4]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:26:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:03 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 Apr 29 17:26:03 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:03 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab" returned: 0 in 0.971s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:26:03 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ab78b4-24e8-4bdd-b677-317952e69476]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:26:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:03 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2 Apr 29 17:26:03 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:04 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951" returned: 0 in 0.854s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:04 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634 Apr 29 17:26:04 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:04 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2" returned: 0 in 0.862s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:04 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab Apr 29 17:26:04 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:05 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634" returned: 0 in 0.960s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:05 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634 Apr 29 17:26:05 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:05 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:26:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:26:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:26:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab" returned: 0 in 1.050s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:05 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:26:05 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:05 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab Apr 29 17:26:05 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:06 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951.8b1883dc-61eb-4b63-b8d8-710274849634" returned: 0 in 1.089s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-8b1883dc-61eb-4b63-b8d8-710274849634" released by "_delete_snapshot" :: held 4.057s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-43810c29-4c2a-4de4-a8df-5ce9a4457951" released by "delete_snapshot" :: held 4.094s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:06 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Created reservations ['6d07c94c-8ecf-4c8f-ba57-cdd2d8b83d26', '0585d009-c0a4-4b31-b62e-3c66554d6174', 'cfaec1c5-7f35-4998-8048-abbd120d4bd4', 'c9e92579-33ae-4e86-ad31-8f0f2ed5174d'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:26:06 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2.864e455f-8b7d-4457-bf80-456d95fa54ab" returned: 0 in 0.881s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] Lock "cinder-quobyte-864e455f-8b7d-4457-bf80-456d95fa54ab" released by "_delete_snapshot" :: held 3.968s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] Lock "cinder-quobyte-efa3f8ed-b9ef-417d-a61f-202bc76479c2" released by "delete_snapshot" :: held 4.016s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:06 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Delete snapshot completed successfully. Apr 29 17:26:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-8b1883dc-61eb-4b63-b8d8-710274849634-delete_snapshot" released by "delete_snapshot" :: held 4.354s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Snapshots deleted, issuing volume delete {{(pid=84547) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 29 17:26:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "cinder-quobyte-43810c29-4c2a-4de4-a8df-5ce9a4457951" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:06 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.031s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:26:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-43810c29-4c2a-4de4-a8df-5ce9a4457951" acquired by "delete_volume" :: waited 0.025s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:06 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] Created reservations ['ef24c02f-b2e0-4e37-9bf6-a4c389274dd6', 'c4274cd6-e1b9-4fc8-a339-9b3c663faf8f', 'fd2a1f95-ecb5-446a-bc40-40b27bcfae91', 'de87368a-f603-4439-b510-fb3f973efcb0'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:26:06 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c44cbb1-6065-47f0-a60b-ad39b9bad0e3]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:26:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:06 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] Delete snapshot completed successfully. Apr 29 17:26:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-efc3c4cf-d52d-4750-ba44-42c6d98976cc tempest-VolumesExtendTest-421846900 None] Lock "cinder-864e455f-8b7d-4457-bf80-456d95fa54ab-delete_snapshot" released by "delete_snapshot" :: held 4.275s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:06 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 Apr 29 17:26:06 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:07 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-18488f1b-5895-4efb-a298-511619c25310 tempest-VolumesExtendTest-421846900 None] Acquiring lock "cinder-efa3f8ed-b9ef-417d-a61f-202bc76479c2-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:07 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-18488f1b-5895-4efb-a298-511619c25310 tempest-VolumesExtendTest-421846900 None] Lock "cinder-efa3f8ed-b9ef-417d-a61f-202bc76479c2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:07 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-18488f1b-5895-4efb-a298-511619c25310 tempest-VolumesExtendTest-421846900 None] Acquiring lock "cinder-quobyte-efa3f8ed-b9ef-417d-a61f-202bc76479c2" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:07 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-18488f1b-5895-4efb-a298-511619c25310 tempest-VolumesExtendTest-421846900 None] Lock "cinder-quobyte-efa3f8ed-b9ef-417d-a61f-202bc76479c2" acquired by "delete_volume" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:07 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef023bf-d501-4a65-ac0c-764fd9af29f0]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:26:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-18488f1b-5895-4efb-a298-511619c25310 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:07 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2 Apr 29 17:26:07 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:07 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951" returned: 0 in 0.904s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:07 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951 Apr 29 17:26:07 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:08 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-18488f1b-5895-4efb-a298-511619c25310 tempest-VolumesExtendTest-421846900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2" returned: 0 in 0.903s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-18488f1b-5895-4efb-a298-511619c25310 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:08 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2 Apr 29 17:26:08 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:08 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-43810c29-4c2a-4de4-a8df-5ce9a4457951" returned: 0 in 0.779s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:08 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-43810c29-4c2a-4de4-a8df-5ce9a4457951" released by "delete_volume" :: held 1.759s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:08 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Created reservations ['db4865ef-5c18-46bd-aa44-c801eae14399', 'ed0af088-77c1-484c-af66-16002176eadf', 'c4aa7408-813d-4eb3-8f54-71c18ec0bc47', '31a8eb96-96fd-4851-8be6-6d503cb35196'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:26:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:26:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:26:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:08 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:26:08 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:08 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:08 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-77745912-d786-46aa-8810-e39b2a7b6e2c tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "cinder-c98f4f4a-3937-44fd-ae04-dacdff7194b8-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-18488f1b-5895-4efb-a298-511619c25310 tempest-VolumesExtendTest-421846900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-efa3f8ed-b9ef-417d-a61f-202bc76479c2" returned: 0 in 0.841s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:09 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-18488f1b-5895-4efb-a298-511619c25310 tempest-VolumesExtendTest-421846900 None] Lock "cinder-quobyte-efa3f8ed-b9ef-417d-a61f-202bc76479c2" released by "delete_volume" :: held 1.864s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:09 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-77745912-d786-46aa-8810-e39b2a7b6e2c tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-c98f4f4a-3937-44fd-ae04-dacdff7194b8-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:09 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-77745912-d786-46aa-8810-e39b2a7b6e2c tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "cinder-quobyte-c98f4f4a-3937-44fd-ae04-dacdff7194b8" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:09 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-77745912-d786-46aa-8810-e39b2a7b6e2c tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-c98f4f4a-3937-44fd-ae04-dacdff7194b8" acquired by "delete_volume" :: waited 0.043s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:09 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-18488f1b-5895-4efb-a298-511619c25310 tempest-VolumesExtendTest-421846900 None] Created reservations ['f3081f50-f21d-47b9-b585-b8b1083325c5', '6d21bb50-788d-4228-b100-5858f3eef4be', '0613319d-a007-4ad7-b931-7eee38429c22', 'e600e009-b23a-42b8-8985-7c24790ec297'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:26:09 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e13396c-ecf8-4471-9b55-1028ef4abc88]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:26:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-77745912-d786-46aa-8810-e39b2a7b6e2c tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c98f4f4a-3937-44fd-ae04-dacdff7194b8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-18488f1b-5895-4efb-a298-511619c25310 tempest-VolumesExtendTest-421846900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-18488f1b-5895-4efb-a298-511619c25310 tempest-VolumesExtendTest-421846900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-18488f1b-5895-4efb-a298-511619c25310 tempest-VolumesExtendTest-421846900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:26:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-18488f1b-5895-4efb-a298-511619c25310 tempest-VolumesExtendTest-421846900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:26:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-18488f1b-5895-4efb-a298-511619c25310 tempest-VolumesExtendTest-421846900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-18488f1b-5895-4efb-a298-511619c25310 tempest-VolumesExtendTest-421846900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:09 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:26:09 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:09 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c98f4f4a-3937-44fd-ae04-dacdff7194b8 Apr 29 17:26:09 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:09 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.909s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:09 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:26:09 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Deleted volume successfully. Apr 29 17:26:09 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2d956090-30cd-4712-a77d-9f2a15eee4e4 tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-43810c29-4c2a-4de4-a8df-5ce9a4457951-delete_volume" released by "delete_volume" :: held 7.398s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:10 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-18488f1b-5895-4efb-a298-511619c25310 tempest-VolumesExtendTest-421846900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.813s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:10 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-18488f1b-5895-4efb-a298-511619c25310 tempest-VolumesExtendTest-421846900 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:26:10 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-18488f1b-5895-4efb-a298-511619c25310 tempest-VolumesExtendTest-421846900 None] Deleted volume successfully. Apr 29 17:26:10 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-18488f1b-5895-4efb-a298-511619c25310 tempest-VolumesExtendTest-421846900 None] Lock "cinder-efa3f8ed-b9ef-417d-a61f-202bc76479c2-delete_volume" released by "delete_volume" :: held 3.100s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:10 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-77745912-d786-46aa-8810-e39b2a7b6e2c tempest-VolumesDeleteCascade-1185488377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c98f4f4a-3937-44fd-ae04-dacdff7194b8" returned: 0 in 1.206s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-77745912-d786-46aa-8810-e39b2a7b6e2c tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c98f4f4a-3937-44fd-ae04-dacdff7194b8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:10 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c98f4f4a-3937-44fd-ae04-dacdff7194b8 Apr 29 17:26:10 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:11 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-77745912-d786-46aa-8810-e39b2a7b6e2c tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c98f4f4a-3937-44fd-ae04-dacdff7194b8" returned: 0 in 0.622s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:11 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-77745912-d786-46aa-8810-e39b2a7b6e2c tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-quobyte-c98f4f4a-3937-44fd-ae04-dacdff7194b8" released by "delete_volume" :: held 1.926s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:11 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-77745912-d786-46aa-8810-e39b2a7b6e2c tempest-VolumesDeleteCascade-1185488377 None] Created reservations ['90d3f54e-7c6d-4c4a-a5fa-5dbaf6d2a86e', '485a9d53-802e-4c10-8de0-2cacea1e1455', '5439ae0a-2102-4855-a810-dc8785944343', '96f8b2cc-7d13-4cf8-9fe9-7382cdac667a'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:26:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-77745912-d786-46aa-8810-e39b2a7b6e2c tempest-VolumesDeleteCascade-1185488377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-77745912-d786-46aa-8810-e39b2a7b6e2c tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-77745912-d786-46aa-8810-e39b2a7b6e2c tempest-VolumesDeleteCascade-1185488377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:26:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-77745912-d786-46aa-8810-e39b2a7b6e2c tempest-VolumesDeleteCascade-1185488377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:26:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-77745912-d786-46aa-8810-e39b2a7b6e2c tempest-VolumesDeleteCascade-1185488377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-77745912-d786-46aa-8810-e39b2a7b6e2c tempest-VolumesDeleteCascade-1185488377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:11 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:26:11 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:12 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-77745912-d786-46aa-8810-e39b2a7b6e2c tempest-VolumesDeleteCascade-1185488377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.801s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:12 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-77745912-d786-46aa-8810-e39b2a7b6e2c tempest-VolumesDeleteCascade-1185488377 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:26:12 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-77745912-d786-46aa-8810-e39b2a7b6e2c tempest-VolumesDeleteCascade-1185488377 None] Deleted volume successfully. Apr 29 17:26:12 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-77745912-d786-46aa-8810-e39b2a7b6e2c tempest-VolumesDeleteCascade-1185488377 None] Lock "cinder-c98f4f4a-3937-44fd-ae04-dacdff7194b8-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:18 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Flow 'volume_create_manager' (2e20168b-7864-4913-b14b-74da8b4576b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8cbf6e-1db4-41b2-bf25-e7b6b0a79839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8cbf6e-1db4-41b2-bf25-e7b6b0a79839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1856164830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0be23cf-6510-4832-ac91-27418419a6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236b26ac29de437da4425ffa82cf3199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:26:19Z,use_quota=True,user_id='cc94227a063f4ac4a96ca927346d513a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a236d992-b228-4d72-878b-f51df4af524c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a236d992-b228-4d72-878b-f51df4af524c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a596a285-ad39-487d-9ed3-473c78988f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a596a285-ad39-487d-9ed3-473c78988f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0be23cf-6510-4832-ac91-27418419a6a5', 'volume_name': 'volume-b0be23cf-6510-4832-ac91-27418419a6a5', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c7f4e6f-97b6-4ec0-81f6-09a9c6dcd015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c7f4e6f-97b6-4ec0-81f6-09a9c6dcd015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c5cbc2-2a7d-48f8-9160-476c7689ef1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:19 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Volume b0be23cf-6510-4832-ac91-27418419a6a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0be23cf-6510-4832-ac91-27418419a6a5', 'volume_size': 1} Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1856164830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0be23cf-6510-4832-ac91-27418419a6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236b26ac29de437da4425ffa82cf3199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:26:19Z,use_quota=True,user_id='cc94227a063f4ac4a96ca927346d513a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Creating volume b0be23cf-6510-4832-ac91-27418419a6a5 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:26:19 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:26:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-b0be23cf-6510-4832-ac91-27418419a6a5 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:19 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-b0be23cf-6510-4832-ac91-27418419a6a5 1073741824 Apr 29 17:26:19 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:20 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-b0be23cf-6510-4832-ac91-27418419a6a5 1073741824" returned: 0 in 1.053s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Flow 'volume_create_manager' (1ecac8b3-34e2-4786-a032-19002836cd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ba8660-d6c7-4924-8ce4-6487cd95fe2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ba8660-d6c7-4924-8ce4-6487cd95fe2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1172649831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c533655-3cbd-4966-baf8-e42983a6ad92,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0f0acd1836a54a43aae01826e7fa6ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:26:20Z,use_quota=True,user_id='b2024865a13e4d0f8f5274024352517f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164e9b65-a8fe-40f9-9192-b55554e3156f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164e9b65-a8fe-40f9-9192-b55554e3156f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c8129a-2f21-4760-a2bd-1a273c7c0890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c8129a-2f21-4760-a2bd-1a273c7c0890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c533655-3cbd-4966-baf8-e42983a6ad92', 'volume_name': 'volume-2c533655-3cbd-4966-baf8-e42983a6ad92', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd81e431-8a30-4b24-8855-0eef88754001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd81e431-8a30-4b24-8855-0eef88754001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0df974d-c9ba-403c-9049-71d495757712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:20 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Volume 2c533655-3cbd-4966-baf8-e42983a6ad92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c533655-3cbd-4966-baf8-e42983a6ad92', 'volume_size': 1} Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-b0be23cf-6510-4832-ac91-27418419a6a5 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:20 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-b0be23cf-6510-4832-ac91-27418419a6a5 Apr 29 17:26:20 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:20 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-b0be23cf-6510-4832-ac91-27418419a6a5" returned: 0 in 0.618s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.639s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1172649831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c533655-3cbd-4966-baf8-e42983a6ad92,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0f0acd1836a54a43aae01826e7fa6ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:26:20Z,use_quota=True,user_id='b2024865a13e4d0f8f5274024352517f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Creating volume 2c533655-3cbd-4966-baf8-e42983a6ad92 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:26:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.063s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:26:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:26:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:26:21 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:26:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c533655-3cbd-4966-baf8-e42983a6ad92 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9c5cbc2-2a7d-48f8-9160-476c7689ef1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0be23cf-6510-4832-ac91-27418419a6a5', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec481b6-183a-42f2-8a90-72ed1de98ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:21 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c533655-3cbd-4966-baf8-e42983a6ad92 1073741824 Apr 29 17:26:21 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:21 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Volume volume-b0be23cf-6510-4832-ac91-27418419a6a5 (b0be23cf-6510-4832-ac91-27418419a6a5): created successfully Apr 29 17:26:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec481b6-183a-42f2-8a90-72ed1de98ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Flow 'volume_create_manager' (2e20168b-7864-4913-b14b-74da8b4576b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:26:21 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e248e91b-5097-4e95-8a16-8360e0094a4b tempest-VolumesTransfersV355Test-1910599234 None] Created volume successfully. Apr 29 17:26:22 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c533655-3cbd-4966-baf8-e42983a6ad92 1073741824" returned: 0 in 1.014s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c533655-3cbd-4966-baf8-e42983a6ad92 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:22 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c533655-3cbd-4966-baf8-e42983a6ad92 Apr 29 17:26:22 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:23 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c533655-3cbd-4966-baf8-e42983a6ad92" returned: 0 in 0.956s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:23 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:26:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0df974d-c9ba-403c-9049-71d495757712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c533655-3cbd-4966-baf8-e42983a6ad92', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d41ef917-2cae-4fc2-ad1e-968c0d69f3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:23 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Volume volume-2c533655-3cbd-4966-baf8-e42983a6ad92 (2c533655-3cbd-4966-baf8-e42983a6ad92): created successfully Apr 29 17:26:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d41ef917-2cae-4fc2-ad1e-968c0d69f3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Flow 'volume_create_manager' (1ecac8b3-34e2-4786-a032-19002836cd43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:26:23 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-fb5246e2-1a32-48c4-8888-59f119fc19ce tempest-VolumesListTestJSON-2002259448 None] Created volume successfully. Apr 29 17:26:23 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-92c4871b-1606-4087-81a1-3ee42f69a2c1 tempest-VolumesTransfersV355Test-786887702 None] Transfer volume completed successfully. Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Flow 'volume_create_manager' (17b5b8ad-38cb-48d4-89a5-63cae42e1fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb212a6b-456c-4b88-a98d-9402a23a0eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb212a6b-456c-4b88-a98d-9402a23a0eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-940664455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adcf05ab-c537-45ae-b83b-bfad526ac305,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0f0acd1836a54a43aae01826e7fa6ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:26:24Z,use_quota=True,user_id='b2024865a13e4d0f8f5274024352517f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85202c9a-8131-41cb-a861-047e2e384280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85202c9a-8131-41cb-a861-047e2e384280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0af241e-e688-4053-9bd3-63818ddf4903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0af241e-e688-4053-9bd3-63818ddf4903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adcf05ab-c537-45ae-b83b-bfad526ac305', 'volume_name': 'volume-adcf05ab-c537-45ae-b83b-bfad526ac305', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0627dd14-9949-475f-96e6-24a23def6238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0627dd14-9949-475f-96e6-24a23def6238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b606d80c-7939-4958-bcd3-32d533e0f3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:24 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Volume adcf05ab-c537-45ae-b83b-bfad526ac305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adcf05ab-c537-45ae-b83b-bfad526ac305', 'volume_size': 1} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-940664455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adcf05ab-c537-45ae-b83b-bfad526ac305,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0f0acd1836a54a43aae01826e7fa6ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:26:24Z,use_quota=True,user_id='b2024865a13e4d0f8f5274024352517f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Creating volume adcf05ab-c537-45ae-b83b-bfad526ac305 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:26:24 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-adcf05ab-c537-45ae-b83b-bfad526ac305 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:24 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-adcf05ab-c537-45ae-b83b-bfad526ac305 1073741824 Apr 29 17:26:24 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad84e6a7-f6f1-4231-a5de-d181f205e1c7 tempest-VolumesTransfersV355Test-934608554 None] Acquiring lock "cinder-b0be23cf-6510-4832-ac91-27418419a6a5-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad84e6a7-f6f1-4231-a5de-d181f205e1c7 tempest-VolumesTransfersV355Test-934608554 None] Lock "cinder-b0be23cf-6510-4832-ac91-27418419a6a5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad84e6a7-f6f1-4231-a5de-d181f205e1c7 tempest-VolumesTransfersV355Test-934608554 None] Acquiring lock "cinder-quobyte-b0be23cf-6510-4832-ac91-27418419a6a5" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad84e6a7-f6f1-4231-a5de-d181f205e1c7 tempest-VolumesTransfersV355Test-934608554 None] Lock "cinder-quobyte-b0be23cf-6510-4832-ac91-27418419a6a5" acquired by "delete_volume" :: waited 0.046s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbf13bf-99e1-49d2-bd47-a06f15c5b330]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:26:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad84e6a7-f6f1-4231-a5de-d181f205e1c7 tempest-VolumesTransfersV355Test-934608554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-b0be23cf-6510-4832-ac91-27418419a6a5 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:24 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-b0be23cf-6510-4832-ac91-27418419a6a5 Apr 29 17:26:24 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:25 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-adcf05ab-c537-45ae-b83b-bfad526ac305 1073741824" returned: 0 in 1.051s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-adcf05ab-c537-45ae-b83b-bfad526ac305 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:25 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-adcf05ab-c537-45ae-b83b-bfad526ac305 Apr 29 17:26:25 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:25 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad84e6a7-f6f1-4231-a5de-d181f205e1c7 tempest-VolumesTransfersV355Test-934608554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-b0be23cf-6510-4832-ac91-27418419a6a5" returned: 0 in 0.814s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad84e6a7-f6f1-4231-a5de-d181f205e1c7 tempest-VolumesTransfersV355Test-934608554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-b0be23cf-6510-4832-ac91-27418419a6a5 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:25 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-b0be23cf-6510-4832-ac91-27418419a6a5 Apr 29 17:26:25 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:26 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-adcf05ab-c537-45ae-b83b-bfad526ac305" returned: 0 in 0.751s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:26:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b606d80c-7939-4958-bcd3-32d533e0f3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adcf05ab-c537-45ae-b83b-bfad526ac305', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7b48ab-cb91-4229-97a7-11eb9a9b9cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:26 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Volume volume-adcf05ab-c537-45ae-b83b-bfad526ac305 (adcf05ab-c537-45ae-b83b-bfad526ac305): created successfully Apr 29 17:26:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7b48ab-cb91-4229-97a7-11eb9a9b9cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Flow 'volume_create_manager' (17b5b8ad-38cb-48d4-89a5-63cae42e1fca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:26:26 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-7b04bfda-f88e-47b2-b5bd-26b123aa059e tempest-VolumesListTestJSON-2002259448 None] Created volume successfully. Apr 29 17:26:26 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad84e6a7-f6f1-4231-a5de-d181f205e1c7 tempest-VolumesTransfersV355Test-934608554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-b0be23cf-6510-4832-ac91-27418419a6a5" returned: 0 in 0.686s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad84e6a7-f6f1-4231-a5de-d181f205e1c7 tempest-VolumesTransfersV355Test-934608554 None] Lock "cinder-quobyte-b0be23cf-6510-4832-ac91-27418419a6a5" released by "delete_volume" :: held 1.587s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:26 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-ad84e6a7-f6f1-4231-a5de-d181f205e1c7 tempest-VolumesTransfersV355Test-934608554 None] Created reservations ['40229106-a058-4133-b58c-f9bf3656e588', 'f17adc27-5661-4ecc-a585-44ea9581012e', '933d80de-8574-4c72-b163-9e7beedce086', '817c760c-ede5-4043-b02b-cd28039f3fea'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:26:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ad84e6a7-f6f1-4231-a5de-d181f205e1c7 tempest-VolumesTransfersV355Test-934608554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ad84e6a7-f6f1-4231-a5de-d181f205e1c7 tempest-VolumesTransfersV355Test-934608554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ad84e6a7-f6f1-4231-a5de-d181f205e1c7 tempest-VolumesTransfersV355Test-934608554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:26:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ad84e6a7-f6f1-4231-a5de-d181f205e1c7 tempest-VolumesTransfersV355Test-934608554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:26:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ad84e6a7-f6f1-4231-a5de-d181f205e1c7 tempest-VolumesTransfersV355Test-934608554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad84e6a7-f6f1-4231-a5de-d181f205e1c7 tempest-VolumesTransfersV355Test-934608554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:26 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:26:26 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:27 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ad84e6a7-f6f1-4231-a5de-d181f205e1c7 tempest-VolumesTransfersV355Test-934608554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.686s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-ad84e6a7-f6f1-4231-a5de-d181f205e1c7 tempest-VolumesTransfersV355Test-934608554 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:26:27 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ad84e6a7-f6f1-4231-a5de-d181f205e1c7 tempest-VolumesTransfersV355Test-934608554 None] Deleted volume successfully. Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ad84e6a7-f6f1-4231-a5de-d181f205e1c7 tempest-VolumesTransfersV355Test-934608554 None] Lock "cinder-b0be23cf-6510-4832-ac91-27418419a6a5-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Flow 'volume_create_manager' (db49ad13-570d-4e0c-84dd-5a9e9400e741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8176ef22-8ce2-409c-9a06-1b5bc676b9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8176ef22-8ce2-409c-9a06-1b5bc676b9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1381141687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d40d767-43da-4a0b-a02a-7370f6eb153b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236b26ac29de437da4425ffa82cf3199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:26:28Z,use_quota=True,user_id='cc94227a063f4ac4a96ca927346d513a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8618464-217d-4e7b-a457-015683a41e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8618464-217d-4e7b-a457-015683a41e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434207d5-bc4a-406f-b533-04a24870cd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (434207d5-bc4a-406f-b533-04a24870cd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d40d767-43da-4a0b-a02a-7370f6eb153b', 'volume_name': 'volume-8d40d767-43da-4a0b-a02a-7370f6eb153b', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab12657-f32c-4f67-8657-6fedb0a6e39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab12657-f32c-4f67-8657-6fedb0a6e39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c30363-88e2-47dd-bf14-87b2f346516c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:27 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Volume 8d40d767-43da-4a0b-a02a-7370f6eb153b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d40d767-43da-4a0b-a02a-7370f6eb153b', 'volume_size': 1} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1381141687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d40d767-43da-4a0b-a02a-7370f6eb153b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='236b26ac29de437da4425ffa82cf3199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:26:28Z,use_quota=True,user_id='cc94227a063f4ac4a96ca927346d513a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Creating volume 8d40d767-43da-4a0b-a02a-7370f6eb153b {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:26:27 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8d40d767-43da-4a0b-a02a-7370f6eb153b 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:27 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8d40d767-43da-4a0b-a02a-7370f6eb153b 1073741824 Apr 29 17:26:27 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Flow 'volume_create_manager' (228b401d-9236-4f6a-a584-fe3ee7b09fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af64bfab-e7df-4435-9c9f-fc8d01f14408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af64bfab-e7df-4435-9c9f-fc8d01f14408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-481219281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6324f9c-ec62-4c5b-b55e-313471fb73e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0f0acd1836a54a43aae01826e7fa6ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:26:28Z,use_quota=True,user_id='b2024865a13e4d0f8f5274024352517f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17e9d95-0ea4-4783-b49f-50c1919482f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17e9d95-0ea4-4783-b49f-50c1919482f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f899c65-ab5e-4a41-9421-09de12c7f57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f899c65-ab5e-4a41-9421-09de12c7f57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6324f9c-ec62-4c5b-b55e-313471fb73e0', 'volume_name': 'volume-f6324f9c-ec62-4c5b-b55e-313471fb73e0', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa379f2-0883-420f-9e7c-d44ede42a724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa379f2-0883-420f-9e7c-d44ede42a724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:28 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d971096-112a-47b6-82ee-ea75c46520fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:28 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Volume f6324f9c-ec62-4c5b-b55e-313471fb73e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6324f9c-ec62-4c5b-b55e-313471fb73e0', 'volume_size': 1} Apr 29 17:26:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:28 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8d40d767-43da-4a0b-a02a-7370f6eb153b 1073741824" returned: 0 in 1.086s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8d40d767-43da-4a0b-a02a-7370f6eb153b {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:28 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8d40d767-43da-4a0b-a02a-7370f6eb153b Apr 29 17:26:28 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:29 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8d40d767-43da-4a0b-a02a-7370f6eb153b" returned: 0 in 0.610s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:26:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.420s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-481219281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6324f9c-ec62-4c5b-b55e-313471fb73e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0f0acd1836a54a43aae01826e7fa6ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:26:28Z,use_quota=True,user_id='b2024865a13e4d0f8f5274024352517f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:26:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Creating volume f6324f9c-ec62-4c5b-b55e-313471fb73e0 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:26:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:26:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:26:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:26:29 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:26:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f6324f9c-ec62-4c5b-b55e-313471fb73e0 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c30363-88e2-47dd-bf14-87b2f346516c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d40d767-43da-4a0b-a02a-7370f6eb153b', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:29 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f6324f9c-ec62-4c5b-b55e-313471fb73e0 1073741824 Apr 29 17:26:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735ff996-ceda-448e-9d4c-6c5ba6fc190a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:29 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:29 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Volume volume-8d40d767-43da-4a0b-a02a-7370f6eb153b (8d40d767-43da-4a0b-a02a-7370f6eb153b): created successfully Apr 29 17:26:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735ff996-ceda-448e-9d4c-6c5ba6fc190a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Flow 'volume_create_manager' (db49ad13-570d-4e0c-84dd-5a9e9400e741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:26:29 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-212d89de-e672-4435-a316-5b71f9f31bea tempest-VolumesTransfersV355Test-1910599234 None] Created volume successfully. Apr 29 17:26:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-39971bb5-1163-48bd-bd5a-3596d7b12066 tempest-VolumesTransfersV355Test-934608554 None] Acquiring lock "cinder-8d40d767-43da-4a0b-a02a-7370f6eb153b-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-39971bb5-1163-48bd-bd5a-3596d7b12066 tempest-VolumesTransfersV355Test-934608554 None] Lock "cinder-8d40d767-43da-4a0b-a02a-7370f6eb153b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-39971bb5-1163-48bd-bd5a-3596d7b12066 tempest-VolumesTransfersV355Test-934608554 None] Acquiring lock "cinder-quobyte-8d40d767-43da-4a0b-a02a-7370f6eb153b" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-39971bb5-1163-48bd-bd5a-3596d7b12066 tempest-VolumesTransfersV355Test-934608554 None] Lock "cinder-quobyte-8d40d767-43da-4a0b-a02a-7370f6eb153b" acquired by "delete_volume" :: waited 0.045s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:30 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b55251-4a25-499a-9252-9ad733868695]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:26:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-39971bb5-1163-48bd-bd5a-3596d7b12066 tempest-VolumesTransfersV355Test-934608554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8d40d767-43da-4a0b-a02a-7370f6eb153b {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:30 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8d40d767-43da-4a0b-a02a-7370f6eb153b Apr 29 17:26:30 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:31 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f6324f9c-ec62-4c5b-b55e-313471fb73e0 1073741824" returned: 0 in 1.621s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f6324f9c-ec62-4c5b-b55e-313471fb73e0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:31 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f6324f9c-ec62-4c5b-b55e-313471fb73e0 Apr 29 17:26:31 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:31 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-39971bb5-1163-48bd-bd5a-3596d7b12066 tempest-VolumesTransfersV355Test-934608554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8d40d767-43da-4a0b-a02a-7370f6eb153b" returned: 0 in 1.391s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-39971bb5-1163-48bd-bd5a-3596d7b12066 tempest-VolumesTransfersV355Test-934608554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8d40d767-43da-4a0b-a02a-7370f6eb153b {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:31 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8d40d767-43da-4a0b-a02a-7370f6eb153b Apr 29 17:26:31 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:32 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f6324f9c-ec62-4c5b-b55e-313471fb73e0" returned: 0 in 1.043s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] <== create_volume: return (2752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:26:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.755s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d971096-112a-47b6-82ee-ea75c46520fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6324f9c-ec62-4c5b-b55e-313471fb73e0', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d0ee79-3050-4971-a1f5-c288f858b2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:32 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Volume volume-f6324f9c-ec62-4c5b-b55e-313471fb73e0 (f6324f9c-ec62-4c5b-b55e-313471fb73e0): created successfully Apr 29 17:26:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71d0ee79-3050-4971-a1f5-c288f858b2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Flow 'volume_create_manager' (228b401d-9236-4f6a-a584-fe3ee7b09fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:26:32 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-75fdf70f-e445-41e4-869a-0266d0a93bdf tempest-VolumesListTestJSON-2002259448 None] Created volume successfully. Apr 29 17:26:32 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-39971bb5-1163-48bd-bd5a-3596d7b12066 tempest-VolumesTransfersV355Test-934608554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8d40d767-43da-4a0b-a02a-7370f6eb153b" returned: 0 in 0.832s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-39971bb5-1163-48bd-bd5a-3596d7b12066 tempest-VolumesTransfersV355Test-934608554 None] Lock "cinder-quobyte-8d40d767-43da-4a0b-a02a-7370f6eb153b" released by "delete_volume" :: held 2.307s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:32 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-39971bb5-1163-48bd-bd5a-3596d7b12066 tempest-VolumesTransfersV355Test-934608554 None] Created reservations ['fd490f8b-23b7-4415-837b-9585bd65a7ea', '15a3c7d8-eb45-499a-b1ba-d42e34512a30', 'e65a54f6-9bf2-4955-ab6b-0b8dcc3c6901', 'd44e59a1-6802-42e0-b45a-14adff2df154'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:26:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-39971bb5-1163-48bd-bd5a-3596d7b12066 tempest-VolumesTransfersV355Test-934608554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-39971bb5-1163-48bd-bd5a-3596d7b12066 tempest-VolumesTransfersV355Test-934608554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-39971bb5-1163-48bd-bd5a-3596d7b12066 tempest-VolumesTransfersV355Test-934608554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:26:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-39971bb5-1163-48bd-bd5a-3596d7b12066 tempest-VolumesTransfersV355Test-934608554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:26:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-39971bb5-1163-48bd-bd5a-3596d7b12066 tempest-VolumesTransfersV355Test-934608554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-39971bb5-1163-48bd-bd5a-3596d7b12066 tempest-VolumesTransfersV355Test-934608554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:32 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:26:32 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:34 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-39971bb5-1163-48bd-bd5a-3596d7b12066 tempest-VolumesTransfersV355Test-934608554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.123s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:34 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-39971bb5-1163-48bd-bd5a-3596d7b12066 tempest-VolumesTransfersV355Test-934608554 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:26:34 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-39971bb5-1163-48bd-bd5a-3596d7b12066 tempest-VolumesTransfersV355Test-934608554 None] Deleted volume successfully. Apr 29 17:26:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-39971bb5-1163-48bd-bd5a-3596d7b12066 tempest-VolumesTransfersV355Test-934608554 None] Lock "cinder-8d40d767-43da-4a0b-a02a-7370f6eb153b-delete_volume" released by "delete_volume" :: held 3.836s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:39 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-496f8636-4375-4686-a6f4-745912fc1265 tempest-VolumesListTestJSON-2002259448 None] Acquiring lock "cinder-f6324f9c-ec62-4c5b-b55e-313471fb73e0-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:39 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-496f8636-4375-4686-a6f4-745912fc1265 tempest-VolumesListTestJSON-2002259448 None] Lock "cinder-f6324f9c-ec62-4c5b-b55e-313471fb73e0-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:39 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=97,cinder:INSERT=22,cinder:UPDATE=122,cinder:DELETE=7 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:26:39 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:INSERT=32,cinder:UPDATE=105,cinder:SELECT=77,cinder:DELETE=12 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:26:39 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-496f8636-4375-4686-a6f4-745912fc1265 tempest-VolumesListTestJSON-2002259448 None] Acquiring lock "cinder-quobyte-f6324f9c-ec62-4c5b-b55e-313471fb73e0" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:39 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-496f8636-4375-4686-a6f4-745912fc1265 tempest-VolumesListTestJSON-2002259448 None] Lock "cinder-quobyte-f6324f9c-ec62-4c5b-b55e-313471fb73e0" acquired by "delete_volume" :: waited 0.032s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:39 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c9745c-6d3e-4bd7-914b-50c5373274e9]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:26:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-496f8636-4375-4686-a6f4-745912fc1265 tempest-VolumesListTestJSON-2002259448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f6324f9c-ec62-4c5b-b55e-313471fb73e0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:39 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f6324f9c-ec62-4c5b-b55e-313471fb73e0 Apr 29 17:26:39 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:40 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-496f8636-4375-4686-a6f4-745912fc1265 tempest-VolumesListTestJSON-2002259448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f6324f9c-ec62-4c5b-b55e-313471fb73e0" returned: 0 in 1.490s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-496f8636-4375-4686-a6f4-745912fc1265 tempest-VolumesListTestJSON-2002259448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f6324f9c-ec62-4c5b-b55e-313471fb73e0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:40 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f6324f9c-ec62-4c5b-b55e-313471fb73e0 Apr 29 17:26:40 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:42 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-496f8636-4375-4686-a6f4-745912fc1265 tempest-VolumesListTestJSON-2002259448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f6324f9c-ec62-4c5b-b55e-313471fb73e0" returned: 0 in 1.244s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-496f8636-4375-4686-a6f4-745912fc1265 tempest-VolumesListTestJSON-2002259448 None] Lock "cinder-quobyte-f6324f9c-ec62-4c5b-b55e-313471fb73e0" released by "delete_volume" :: held 2.923s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:42 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-496f8636-4375-4686-a6f4-745912fc1265 tempest-VolumesListTestJSON-2002259448 None] Created reservations ['e0ca6ac3-c64b-4a6f-a791-620af032a1fa', '17eb3126-b3d4-4ae4-8134-5a825e3d36a3', 'c182bef1-663d-45ae-80d1-a9f14505ecb0', 'cee889ec-721c-4f16-b0bf-21efcb08955f'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:26:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-496f8636-4375-4686-a6f4-745912fc1265 tempest-VolumesListTestJSON-2002259448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-496f8636-4375-4686-a6f4-745912fc1265 tempest-VolumesListTestJSON-2002259448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:42 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-496f8636-4375-4686-a6f4-745912fc1265 tempest-VolumesListTestJSON-2002259448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:26:42 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-496f8636-4375-4686-a6f4-745912fc1265 tempest-VolumesListTestJSON-2002259448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:26:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-496f8636-4375-4686-a6f4-745912fc1265 tempest-VolumesListTestJSON-2002259448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-496f8636-4375-4686-a6f4-745912fc1265 tempest-VolumesListTestJSON-2002259448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:42 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:26:42 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:42 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:26:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Flow 'volume_create_manager' (ce58899d-2980-4bad-b2b1-a0fb2a65e870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:26:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e017cc62-83ed-4b40-8b3f-2ea3ba3c6c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e017cc62-83ed-4b40-8b3f-2ea3ba3c6c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2061755709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8745bde7-3b68-4a77-918d-c254811904de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec70790225f4f81b7f529e983449cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:26:43Z,use_quota=True,user_id='28df845d20ea49bbbee122e152679a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7266331-c92c-43a4-afc3-857d1214fdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7266331-c92c-43a4-afc3-857d1214fdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547565c0-9726-4e7a-8dff-a0568249fb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547565c0-9726-4e7a-8dff-a0568249fb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8745bde7-3b68-4a77-918d-c254811904de', 'volume_name': 'volume-8745bde7-3b68-4a77-918d-c254811904de', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d62d239-f1ca-4930-bf1a-ca09fcbec8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d62d239-f1ca-4930-bf1a-ca09fcbec8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74e2ff6-acb4-428c-b45f-f2ad65d64eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:43 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Volume 8745bde7-3b68-4a77-918d-c254811904de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8745bde7-3b68-4a77-918d-c254811904de', 'volume_size': 1} Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2061755709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8745bde7-3b68-4a77-918d-c254811904de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ec70790225f4f81b7f529e983449cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:26:43Z,use_quota=True,user_id='28df845d20ea49bbbee122e152679a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Creating volume 8745bde7-3b68-4a77-918d-c254811904de {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:26:43 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8745bde7-3b68-4a77-918d-c254811904de 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9c2f6cdb-2b2a-48d6-9c66-bf97914a486f tempest-VolumesListTestJSON-2002259448 None] Acquiring lock "cinder-adcf05ab-c537-45ae-b83b-bfad526ac305-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:43 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8745bde7-3b68-4a77-918d-c254811904de 1073741824 Apr 29 17:26:43 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9c2f6cdb-2b2a-48d6-9c66-bf97914a486f tempest-VolumesListTestJSON-2002259448 None] Lock "cinder-adcf05ab-c537-45ae-b83b-bfad526ac305-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9c2f6cdb-2b2a-48d6-9c66-bf97914a486f tempest-VolumesListTestJSON-2002259448 None] Acquiring lock "cinder-quobyte-adcf05ab-c537-45ae-b83b-bfad526ac305" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9c2f6cdb-2b2a-48d6-9c66-bf97914a486f tempest-VolumesListTestJSON-2002259448 None] Lock "cinder-quobyte-adcf05ab-c537-45ae-b83b-bfad526ac305" acquired by "delete_volume" :: waited 0.075s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[85762328-6ba8-4f31-9d84-68aefb21bb65]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9c2f6cdb-2b2a-48d6-9c66-bf97914a486f tempest-VolumesListTestJSON-2002259448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-adcf05ab-c537-45ae-b83b-bfad526ac305 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:43 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-adcf05ab-c537-45ae-b83b-bfad526ac305 Apr 29 17:26:43 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:43 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-496f8636-4375-4686-a6f4-745912fc1265 tempest-VolumesListTestJSON-2002259448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.278s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-496f8636-4375-4686-a6f4-745912fc1265 tempest-VolumesListTestJSON-2002259448 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:26:43 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-496f8636-4375-4686-a6f4-745912fc1265 tempest-VolumesListTestJSON-2002259448 None] Deleted volume successfully. Apr 29 17:26:43 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-496f8636-4375-4686-a6f4-745912fc1265 tempest-VolumesListTestJSON-2002259448 None] Lock "cinder-f6324f9c-ec62-4c5b-b55e-313471fb73e0-delete_volume" released by "delete_volume" :: held 4.765s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:44 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8745bde7-3b68-4a77-918d-c254811904de 1073741824" returned: 0 in 1.708s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8745bde7-3b68-4a77-918d-c254811904de {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:44 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8745bde7-3b68-4a77-918d-c254811904de Apr 29 17:26:44 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:44 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9c2f6cdb-2b2a-48d6-9c66-bf97914a486f tempest-VolumesListTestJSON-2002259448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-adcf05ab-c537-45ae-b83b-bfad526ac305" returned: 0 in 1.534s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9c2f6cdb-2b2a-48d6-9c66-bf97914a486f tempest-VolumesListTestJSON-2002259448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-adcf05ab-c537-45ae-b83b-bfad526ac305 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:45 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-adcf05ab-c537-45ae-b83b-bfad526ac305 Apr 29 17:26:45 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:45 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8745bde7-3b68-4a77-918d-c254811904de" returned: 0 in 1.032s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] <== create_volume: return (2822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:26:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.825s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74e2ff6-acb4-428c-b45f-f2ad65d64eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8745bde7-3b68-4a77-918d-c254811904de', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99608411-d1f6-4353-b6cc-a346e601e719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:45 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Volume volume-8745bde7-3b68-4a77-918d-c254811904de (8745bde7-3b68-4a77-918d-c254811904de): created successfully Apr 29 17:26:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99608411-d1f6-4353-b6cc-a346e601e719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Flow 'volume_create_manager' (ce58899d-2980-4bad-b2b1-a0fb2a65e870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:26:45 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-2e9248fd-a4b4-4a05-ab62-21779da267d9 tempest-TestMinimumBasicScenario-184983317 None] Created volume successfully. Apr 29 17:26:46 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9c2f6cdb-2b2a-48d6-9c66-bf97914a486f tempest-VolumesListTestJSON-2002259448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-adcf05ab-c537-45ae-b83b-bfad526ac305" returned: 0 in 1.093s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9c2f6cdb-2b2a-48d6-9c66-bf97914a486f tempest-VolumesListTestJSON-2002259448 None] Lock "cinder-quobyte-adcf05ab-c537-45ae-b83b-bfad526ac305" released by "delete_volume" :: held 2.779s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:46 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-9c2f6cdb-2b2a-48d6-9c66-bf97914a486f tempest-VolumesListTestJSON-2002259448 None] Created reservations ['63e69d4e-0a5c-4baf-9817-d1d454c01ef7', '5a027004-ee61-4eb2-8ec8-685dc93a0a6d', 'd9158f5d-a34d-4590-aced-74f3cf7d57f5', 'd71761b5-3474-42f1-a141-d3c1d42e6177'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:26:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9c2f6cdb-2b2a-48d6-9c66-bf97914a486f tempest-VolumesListTestJSON-2002259448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9c2f6cdb-2b2a-48d6-9c66-bf97914a486f tempest-VolumesListTestJSON-2002259448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9c2f6cdb-2b2a-48d6-9c66-bf97914a486f tempest-VolumesListTestJSON-2002259448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:26:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9c2f6cdb-2b2a-48d6-9c66-bf97914a486f tempest-VolumesListTestJSON-2002259448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:26:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9c2f6cdb-2b2a-48d6-9c66-bf97914a486f tempest-VolumesListTestJSON-2002259448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9c2f6cdb-2b2a-48d6-9c66-bf97914a486f tempest-VolumesListTestJSON-2002259448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:46 devstack sudo[104543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:26:46 devstack sudo[104543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a655f024-27cb-4626-97e6-f73097e7a7da tempest-VolumesListTestJSON-2002259448 None] Acquiring lock "cinder-2c533655-3cbd-4966-baf8-e42983a6ad92-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a655f024-27cb-4626-97e6-f73097e7a7da tempest-VolumesListTestJSON-2002259448 None] Lock "cinder-2c533655-3cbd-4966-baf8-e42983a6ad92-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a655f024-27cb-4626-97e6-f73097e7a7da tempest-VolumesListTestJSON-2002259448 None] Acquiring lock "cinder-quobyte-2c533655-3cbd-4966-baf8-e42983a6ad92" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:26:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a655f024-27cb-4626-97e6-f73097e7a7da tempest-VolumesListTestJSON-2002259448 None] Lock "cinder-quobyte-2c533655-3cbd-4966-baf8-e42983a6ad92" acquired by "delete_volume" :: waited 0.027s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:26:46 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3c4273-a58c-4673-9b76-0854f74e14d5]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:26:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a655f024-27cb-4626-97e6-f73097e7a7da tempest-VolumesListTestJSON-2002259448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c533655-3cbd-4966-baf8-e42983a6ad92 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:47 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c533655-3cbd-4966-baf8-e42983a6ad92 Apr 29 17:26:47 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:47 devstack sudo[104543]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9c2f6cdb-2b2a-48d6-9c66-bf97914a486f tempest-VolumesListTestJSON-2002259448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.220s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:47 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-9c2f6cdb-2b2a-48d6-9c66-bf97914a486f tempest-VolumesListTestJSON-2002259448 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:26:47 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-9c2f6cdb-2b2a-48d6-9c66-bf97914a486f tempest-VolumesListTestJSON-2002259448 None] Deleted volume successfully. Apr 29 17:26:47 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9c2f6cdb-2b2a-48d6-9c66-bf97914a486f tempest-VolumesListTestJSON-2002259448 None] Lock "cinder-adcf05ab-c537-45ae-b83b-bfad526ac305-delete_volume" released by "delete_volume" :: held 4.499s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:47 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a655f024-27cb-4626-97e6-f73097e7a7da tempest-VolumesListTestJSON-2002259448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c533655-3cbd-4966-baf8-e42983a6ad92" returned: 0 in 1.002s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a655f024-27cb-4626-97e6-f73097e7a7da tempest-VolumesListTestJSON-2002259448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c533655-3cbd-4966-baf8-e42983a6ad92 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:47 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c533655-3cbd-4966-baf8-e42983a6ad92 Apr 29 17:26:47 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:48 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a655f024-27cb-4626-97e6-f73097e7a7da tempest-VolumesListTestJSON-2002259448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c533655-3cbd-4966-baf8-e42983a6ad92" returned: 0 in 0.682s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:48 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a655f024-27cb-4626-97e6-f73097e7a7da tempest-VolumesListTestJSON-2002259448 None] Lock "cinder-quobyte-2c533655-3cbd-4966-baf8-e42983a6ad92" released by "delete_volume" :: held 1.751s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:48 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-a655f024-27cb-4626-97e6-f73097e7a7da tempest-VolumesListTestJSON-2002259448 None] Created reservations ['222bcd4e-470f-418b-8f3d-9e9dc8aab8f5', 'f14b7cd5-5ea0-4f15-be0c-718c1253a27b', 'a72e7e04-5541-40d9-90bd-9df9506a9a2a', '4b37adf0-2aeb-45d8-84f2-c70b4c469cd8'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:26:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a655f024-27cb-4626-97e6-f73097e7a7da tempest-VolumesListTestJSON-2002259448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a655f024-27cb-4626-97e6-f73097e7a7da tempest-VolumesListTestJSON-2002259448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a655f024-27cb-4626-97e6-f73097e7a7da tempest-VolumesListTestJSON-2002259448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:26:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a655f024-27cb-4626-97e6-f73097e7a7da tempest-VolumesListTestJSON-2002259448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:26:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a655f024-27cb-4626-97e6-f73097e7a7da tempest-VolumesListTestJSON-2002259448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a655f024-27cb-4626-97e6-f73097e7a7da tempest-VolumesListTestJSON-2002259448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:48 devstack sudo[104554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:26:48 devstack sudo[104554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:49 devstack sudo[104554]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a655f024-27cb-4626-97e6-f73097e7a7da tempest-VolumesListTestJSON-2002259448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.811s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:49 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-a655f024-27cb-4626-97e6-f73097e7a7da tempest-VolumesListTestJSON-2002259448 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:26:49 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-a655f024-27cb-4626-97e6-f73097e7a7da tempest-VolumesListTestJSON-2002259448 None] Deleted volume successfully. Apr 29 17:26:49 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a655f024-27cb-4626-97e6-f73097e7a7da tempest-VolumesListTestJSON-2002259448 None] Lock "cinder-2c533655-3cbd-4966-baf8-e42983a6ad92-delete_volume" released by "delete_volume" :: held 2.860s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:26:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-0f7f89d4-c4c2-434b-8051-d6c108fb6bf2 req-9ca9df77-23d2-4894-a814-3c794cb4b536 tempest-TestMinimumBasicScenario-184983317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-0f7f89d4-c4c2-434b-8051-d6c108fb6bf2 req-9ca9df77-23d2-4894-a814-3c794cb4b536 tempest-TestMinimumBasicScenario-184983317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:49 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[717f2dbf-51f0-4d05-8869-1d5940eb874b]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:26:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-0f7f89d4-c4c2-434b-8051-d6c108fb6bf2 req-9ca9df77-23d2-4894-a814-3c794cb4b536 tempest-TestMinimumBasicScenario-184983317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8745bde7-3b68-4a77-918d-c254811904de {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:50 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8745bde7-3b68-4a77-918d-c254811904de Apr 29 17:26:50 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:51 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-0f7f89d4-c4c2-434b-8051-d6c108fb6bf2 req-9ca9df77-23d2-4894-a814-3c794cb4b536 tempest-TestMinimumBasicScenario-184983317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8745bde7-3b68-4a77-918d-c254811904de" returned: 0 in 1.198s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-0f7f89d4-c4c2-434b-8051-d6c108fb6bf2 req-9ca9df77-23d2-4894-a814-3c794cb4b536 tempest-TestMinimumBasicScenario-184983317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.236s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-0f7f89d4-c4c2-434b-8051-d6c108fb6bf2 req-9ca9df77-23d2-4894-a814-3c794cb4b536 tempest-TestMinimumBasicScenario-184983317 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-8745bde7-3b68-4a77-918d-c254811904de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a5341c9-7dc3-470f-988e-d313f0c4fdf3', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:26:51 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-0f7f89d4-c4c2-434b-8051-d6c108fb6bf2 req-9ca9df77-23d2-4894-a814-3c794cb4b536 tempest-TestMinimumBasicScenario-184983317 None] attachment_update completed successfully. Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Flow 'volume_create_manager' (f5b6adec-2a4d-47b6-918a-67edf4badc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b603733-1cc2-46f9-a6d6-40abff65745b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b603733-1cc2-46f9-a6d6-40abff65745b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-94293896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cdfee71-f425-4b94-a4c0-3cb9fea7f25c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a34f77df7c47cea000076809d92de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:26:53Z,use_quota=True,user_id='9b170bb7055b418f88e77d6a385f3a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (943e9b90-0307-4daa-a9bd-514125fb4ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (943e9b90-0307-4daa-a9bd-514125fb4ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cba088e-da99-45f1-b40d-1747525bae16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cba088e-da99-45f1-b40d-1747525bae16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cdfee71-f425-4b94-a4c0-3cb9fea7f25c', 'volume_name': 'volume-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31350d57-0aa9-4ca5-ad16-072bd4e55f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31350d57-0aa9-4ca5-ad16-072bd4e55f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c83997d-e390-479d-a699-cfc8630ef217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:53 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Volume 0cdfee71-f425-4b94-a4c0-3cb9fea7f25c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c', 'volume_size': 1} Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-94293896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cdfee71-f425-4b94-a4c0-3cb9fea7f25c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76a34f77df7c47cea000076809d92de2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:26:53Z,use_quota=True,user_id='9b170bb7055b418f88e77d6a385f3a24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Creating volume 0cdfee71-f425-4b94-a4c0-3cb9fea7f25c {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:26:53 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:26:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:53 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c 1073741824 Apr 29 17:26:53 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:54 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c 1073741824" returned: 0 in 1.129s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:54 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c Apr 29 17:26:54 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:26:55 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Apr 29 17:26:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c" returned: 0 in 0.886s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:26:55 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:26:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c83997d-e390-479d-a699-cfc8630ef217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c6eab4-6645-4029-ae70-f4646aa9456c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:55 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Volume volume-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c (0cdfee71-f425-4b94-a4c0-3cb9fea7f25c): created successfully Apr 29 17:26:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c6eab4-6645-4029-ae70-f4646aa9456c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Flow 'volume_create_manager' (f5b6adec-2a4d-47b6-918a-67edf4badc6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:26:55 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-97ef82c4-9508-4b2b-9044-dfa6bf35cd92 tempest-VolumesNegativeTest-367296451 None] Created volume successfully. Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Flow 'volume_create_manager' (cc8946ef-9cfa-49e7-bd9c-4b15083aed39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df83458-5931-4101-913b-407bda8cc3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df83458-5931-4101-913b-407bda8cc3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-937634157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea354b12-5ea2-4196-9116-dcf290bacb8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01a20da547d40ab8c14c356dcac4f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:26:59Z,use_quota=True,user_id='b5fb28450b394952a107bec17f2350ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0373c5d7-dffe-4460-9f10-19e46efc99b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0373c5d7-dffe-4460-9f10-19e46efc99b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f263cea-ca8a-43d7-9974-70b95111ef2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f263cea-ca8a-43d7-9974-70b95111ef2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea354b12-5ea2-4196-9116-dcf290bacb8b', 'volume_name': 'volume-ea354b12-5ea2-4196-9116-dcf290bacb8b', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f4b38ba-70f3-43f6-99a9-9760e75cc86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f4b38ba-70f3-43f6-99a9-9760e75cc86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c003e7-581a-475f-91fc-a5f80c1f86f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:26:59 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Volume ea354b12-5ea2-4196-9116-dcf290bacb8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea354b12-5ea2-4196-9116-dcf290bacb8b', 'volume_size': 1} Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-937634157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea354b12-5ea2-4196-9116-dcf290bacb8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a01a20da547d40ab8c14c356dcac4f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:26:59Z,use_quota=True,user_id='b5fb28450b394952a107bec17f2350ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Creating volume ea354b12-5ea2-4196-9116-dcf290bacb8b {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:26:59 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:26:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:26:59 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b 1073741824 Apr 29 17:26:59 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:01 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b 1073741824" returned: 0 in 1.563s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:01 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b Apr 29 17:27:01 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:02 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b" returned: 0 in 0.978s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] <== create_volume: return (2608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:27:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.612s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:27:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c003e7-581a-475f-91fc-a5f80c1f86f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea354b12-5ea2-4196-9116-dcf290bacb8b', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:27:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9899568-00a7-4f66-b76b-163969abe48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:27:02 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Volume volume-ea354b12-5ea2-4196-9116-dcf290bacb8b (ea354b12-5ea2-4196-9116-dcf290bacb8b): created successfully Apr 29 17:27:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9899568-00a7-4f66-b76b-163969abe48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:27:02 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Flow 'volume_create_manager' (cc8946ef-9cfa-49e7-bd9c-4b15083aed39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:27:02 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-0987fc3a-2224-4a50-ac1f-d99d8c155aa9 tempest-VolumesActionsTest-867618192 None] Created volume successfully. Apr 29 17:27:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:27:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:27:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:27:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:27:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:27:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:27:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:05 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:27:05 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:06 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.932s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:27:09 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-91b4494e-f21c-4d5c-8b7a-c2aea7060328 req-52ef1c95-6b98-42f9-b633-1c3dbb47d06e tempest-AttachVolumeNegativeTest-698092894 None] Terminate volume connection completed successfully. Apr 29 17:27:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-91b4494e-f21c-4d5c-8b7a-c2aea7060328 req-52ef1c95-6b98-42f9-b633-1c3dbb47d06e tempest-AttachVolumeNegativeTest-698092894 None] Deleting attachment ece11202-8bb9-4d30-a81c-24a2358c5f05. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:27:19 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=21,cinder:INSERT=9,cinder:UPDATE=38,cinder:DELETE=4 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:27:19 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=33,cinder:INSERT=6,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:27:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dcd9ec1c-1d2d-41ee-bba1-5dbad5a4d34a tempest-VolumesActionsTest-867618192 None] Acquiring lock "cinder-ea354b12-5ea2-4196-9116-dcf290bacb8b" by "attach_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:27:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dcd9ec1c-1d2d-41ee-bba1-5dbad5a4d34a tempest-VolumesActionsTest-867618192 None] Lock "cinder-ea354b12-5ea2-4196-9116-dcf290bacb8b" acquired by "attach_volume" :: waited 0.031s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:27:21 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-dcd9ec1c-1d2d-41ee-bba1-5dbad5a4d34a tempest-VolumesActionsTest-867618192 None] Attaching volume ea354b12-5ea2-4196-9116-dcf290bacb8b to instance 8a5ce320-72d8-4d7d-8446-a10d7af87c0e at mountpoint /dev/vdb on host None. Apr 29 17:27:21 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-dcd9ec1c-1d2d-41ee-bba1-5dbad5a4d34a tempest-VolumesActionsTest-867618192 None] Attach volume completed successfully. Apr 29 17:27:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dcd9ec1c-1d2d-41ee-bba1-5dbad5a4d34a tempest-VolumesActionsTest-867618192 None] Lock "cinder-ea354b12-5ea2-4196-9116-dcf290bacb8b" released by "attach_volume" :: held 0.136s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:27:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-553e1a25-12b2-4043-8b64-d092789edc46 tempest-VolumesActionsTest-867618192 None] Acquiring lock "cinder-ea354b12-5ea2-4196-9116-dcf290bacb8b-detach_volume" by "detach_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:27:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-553e1a25-12b2-4043-8b64-d092789edc46 tempest-VolumesActionsTest-867618192 None] Lock "cinder-ea354b12-5ea2-4196-9116-dcf290bacb8b-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:27:21 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-553e1a25-12b2-4043-8b64-d092789edc46 tempest-VolumesActionsTest-867618192 None] Detaching volume ea354b12-5ea2-4196-9116-dcf290bacb8b from instance 8a5ce320-72d8-4d7d-8446-a10d7af87c0e. Apr 29 17:27:21 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-553e1a25-12b2-4043-8b64-d092789edc46 tempest-VolumesActionsTest-867618192 None] Detach volume completed successfully. Apr 29 17:27:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-553e1a25-12b2-4043-8b64-d092789edc46 tempest-VolumesActionsTest-867618192 None] Lock "cinder-ea354b12-5ea2-4196-9116-dcf290bacb8b-detach_volume" released by "detach_volume" :: held 0.091s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:27:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6517a070-fd35-40a3-aebb-2ed59375a6c7 tempest-VolumesNegativeTest-367296451 None] Acquiring lock "cinder-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:27:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6517a070-fd35-40a3-aebb-2ed59375a6c7 tempest-VolumesNegativeTest-367296451 None] Lock "cinder-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:27:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6517a070-fd35-40a3-aebb-2ed59375a6c7 tempest-VolumesNegativeTest-367296451 None] Acquiring lock "cinder-quobyte-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:27:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6517a070-fd35-40a3-aebb-2ed59375a6c7 tempest-VolumesNegativeTest-367296451 None] Lock "cinder-quobyte-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c" acquired by "delete_volume" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:27:31 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05a2451-e7ea-41ae-8dd4-f3353c5f0401]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:27:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6517a070-fd35-40a3-aebb-2ed59375a6c7 tempest-VolumesNegativeTest-367296451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:31 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c Apr 29 17:27:31 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:32 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6517a070-fd35-40a3-aebb-2ed59375a6c7 tempest-VolumesNegativeTest-367296451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c" returned: 0 in 0.913s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6517a070-fd35-40a3-aebb-2ed59375a6c7 tempest-VolumesNegativeTest-367296451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:32 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c Apr 29 17:27:32 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:33 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6517a070-fd35-40a3-aebb-2ed59375a6c7 tempest-VolumesNegativeTest-367296451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c" returned: 0 in 0.827s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:33 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6517a070-fd35-40a3-aebb-2ed59375a6c7 tempest-VolumesNegativeTest-367296451 None] Lock "cinder-quobyte-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c" released by "delete_volume" :: held 1.811s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:27:33 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-6517a070-fd35-40a3-aebb-2ed59375a6c7 tempest-VolumesNegativeTest-367296451 None] Created reservations ['60f4e871-2f55-478b-84ed-e4cecf4b6be4', 'a1bf9141-2d26-4266-a166-8c6788c4c855', '87f225ce-c67e-47a3-bebe-41c607d2e8ce', '3e39cbac-892b-4031-910c-02fe8ff7a228'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:27:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6517a070-fd35-40a3-aebb-2ed59375a6c7 tempest-VolumesNegativeTest-367296451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:27:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6517a070-fd35-40a3-aebb-2ed59375a6c7 tempest-VolumesNegativeTest-367296451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:27:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-6517a070-fd35-40a3-aebb-2ed59375a6c7 tempest-VolumesNegativeTest-367296451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:27:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-6517a070-fd35-40a3-aebb-2ed59375a6c7 tempest-VolumesNegativeTest-367296451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:27:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6517a070-fd35-40a3-aebb-2ed59375a6c7 tempest-VolumesNegativeTest-367296451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:27:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6517a070-fd35-40a3-aebb-2ed59375a6c7 tempest-VolumesNegativeTest-367296451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:33 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:27:33 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:34 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6517a070-fd35-40a3-aebb-2ed59375a6c7 tempest-VolumesNegativeTest-367296451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.981s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:34 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-6517a070-fd35-40a3-aebb-2ed59375a6c7 tempest-VolumesNegativeTest-367296451 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:27:34 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-6517a070-fd35-40a3-aebb-2ed59375a6c7 tempest-VolumesNegativeTest-367296451 None] Deleted volume successfully. Apr 29 17:27:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6517a070-fd35-40a3-aebb-2ed59375a6c7 tempest-VolumesNegativeTest-367296451 None] Lock "cinder-0cdfee71-f425-4b94-a4c0-3cb9fea7f25c-delete_volume" released by "delete_volume" :: held 3.120s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Flow 'volume_create_manager' (9bd3b195-8ba9-4b8c-a1f0-e19d5553351f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c465d394-de4b-4847-9af0-852b74b01f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c465d394-de4b-4847-9af0-852b74b01f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-290022552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aafe820-d467-4754-a487-7b06eab92a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3fefdf9d4f64c9b8dfbcf80421a4366',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:27:37Z,use_quota=True,user_id='3cb7676032f14e2f847a3c1bab9a8244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e336e0-856d-45b2-ac94-20aece7be56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e336e0-856d-45b2-ac94-20aece7be56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512365e0-7adb-4a96-bd38-2acace9f0708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (512365e0-7adb-4a96-bd38-2acace9f0708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aafe820-d467-4754-a487-7b06eab92a86', 'volume_name': 'volume-2aafe820-d467-4754-a487-7b06eab92a86', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87bf87d1-b314-47bb-a778-db7a34ad2231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87bf87d1-b314-47bb-a778-db7a34ad2231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424665e4-d7fb-4cd3-9063-dacb9c53e46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:27:37 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Volume 2aafe820-d467-4754-a487-7b06eab92a86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aafe820-d467-4754-a487-7b06eab92a86', 'volume_size': 1} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-290022552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aafe820-d467-4754-a487-7b06eab92a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3fefdf9d4f64c9b8dfbcf80421a4366',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:27:37Z,use_quota=True,user_id='3cb7676032f14e2f847a3c1bab9a8244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Creating volume 2aafe820-d467-4754-a487-7b06eab92a86 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:27:37 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:27:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:37 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86 1073741824 Apr 29 17:27:37 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:38 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86 1073741824" returned: 0 in 0.957s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:38 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86 Apr 29 17:27:38 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:39 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86" returned: 0 in 0.649s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:27:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:27:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424665e4-d7fb-4cd3-9063-dacb9c53e46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aafe820-d467-4754-a487-7b06eab92a86', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:27:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e861b488-5b2c-4df4-9d03-559347c33b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:27:39 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Volume volume-2aafe820-d467-4754-a487-7b06eab92a86 (2aafe820-d467-4754-a487-7b06eab92a86): created successfully Apr 29 17:27:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e861b488-5b2c-4df4-9d03-559347c33b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:27:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Flow 'volume_create_manager' (9bd3b195-8ba9-4b8c-a1f0-e19d5553351f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:27:39 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-7a11b94e-5886-4ffa-81a2-6e6b9094537f tempest-VolumesSnapshotListTestJSON-644059968 None] Created volume successfully. Apr 29 17:27:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-811c9279-2298-4050-8b2f-b2e9afa122da tempest-VolumesSnapshotListTestJSON-644059968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:27:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-811c9279-2298-4050-8b2f-b2e9afa122da tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:27:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-811c9279-2298-4050-8b2f-b2e9afa122da tempest-VolumesSnapshotListTestJSON-644059968 None] Creating offline snapshot db8c11b8-bf53-40d6-a59b-beae107bc89e of volume 2aafe820-d467-4754-a487-7b06eab92a86 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:27:39 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a288755-affc-4d14-9cd2-5209ae63bccc]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:27:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-811c9279-2298-4050-8b2f-b2e9afa122da tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:39 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86 Apr 29 17:27:39 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:40 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-811c9279-2298-4050-8b2f-b2e9afa122da tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86" returned: 0 in 0.709s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-811c9279-2298-4050-8b2f-b2e9afa122da tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:40 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e 1G Apr 29 17:27:40 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:41 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-811c9279-2298-4050-8b2f-b2e9afa122da tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e 1G" returned: 0 in 1.125s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-811c9279-2298-4050-8b2f-b2e9afa122da tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aafe820-d467-4754-a487-7b06eab92a86 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:41 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aafe820-d467-4754-a487-7b06eab92a86 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e Apr 29 17:27:41 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:42 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-811c9279-2298-4050-8b2f-b2e9afa122da tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aafe820-d467-4754-a487-7b06eab92a86 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e" returned: 0 in 1.029s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:42 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-811c9279-2298-4050-8b2f-b2e9afa122da tempest-VolumesSnapshotListTestJSON-644059968 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e is being set with open permissions: ugo+rw Apr 29 17:27:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-811c9279-2298-4050-8b2f-b2e9afa122da tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:42 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e Apr 29 17:27:42 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:43 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-811c9279-2298-4050-8b2f-b2e9afa122da tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e" returned: 0 in 0.953s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-811c9279-2298-4050-8b2f-b2e9afa122da tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:43 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.info Apr 29 17:27:43 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:44 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-811c9279-2298-4050-8b2f-b2e9afa122da tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.info" returned: 0 in 1.071s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:44 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-811c9279-2298-4050-8b2f-b2e9afa122da tempest-VolumesSnapshotListTestJSON-644059968 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.info is being set with open permissions: ugo+rw Apr 29 17:27:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-811c9279-2298-4050-8b2f-b2e9afa122da tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:44 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.info Apr 29 17:27:44 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:45 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-811c9279-2298-4050-8b2f-b2e9afa122da tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.info" returned: 0 in 1.284s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-811c9279-2298-4050-8b2f-b2e9afa122da tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.278s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:27:45 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-811c9279-2298-4050-8b2f-b2e9afa122da tempest-VolumesSnapshotListTestJSON-644059968 None] Create snapshot completed successfully Apr 29 17:27:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b1c49ef4-5def-4ea5-a47c-df4c347a0e72 tempest-VolumesSnapshotListTestJSON-644059968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:27:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b1c49ef4-5def-4ea5-a47c-df4c347a0e72 tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:27:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-b1c49ef4-5def-4ea5-a47c-df4c347a0e72 tempest-VolumesSnapshotListTestJSON-644059968 None] Creating offline snapshot 45edfbab-a86b-4086-aca6-cec56103a945 of volume 2aafe820-d467-4754-a487-7b06eab92a86 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:27:46 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb7a0a2-bb13-4b42-a436-ffb326a3db47]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:27:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b1c49ef4-5def-4ea5-a47c-df4c347a0e72 tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:46 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e Apr 29 17:27:46 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:47 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b1c49ef4-5def-4ea5-a47c-df4c347a0e72 tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e" returned: 0 in 1.348s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-b1c49ef4-5def-4ea5-a47c-df4c347a0e72 tempest-VolumesSnapshotListTestJSON-644059968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aafe820-d467-4754-a487-7b06eab92a86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:27:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b1c49ef4-5def-4ea5-a47c-df4c347a0e72 tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:47 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 1G Apr 29 17:27:47 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:48 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b1c49ef4-5def-4ea5-a47c-df4c347a0e72 tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 1G" returned: 0 in 0.981s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b1c49ef4-5def-4ea5-a47c-df4c347a0e72 tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:48 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 Apr 29 17:27:48 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:48 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8ed9b405-98e1-4447-8f61-b1e3265389b1 tempest-VolumesActionsTest-867618192 None] Acquiring lock "cinder-ea354b12-5ea2-4196-9116-dcf290bacb8b" by "attach_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:27:48 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8ed9b405-98e1-4447-8f61-b1e3265389b1 tempest-VolumesActionsTest-867618192 None] Lock "cinder-ea354b12-5ea2-4196-9116-dcf290bacb8b" acquired by "attach_volume" :: waited 0.034s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:27:49 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-8ed9b405-98e1-4447-8f61-b1e3265389b1 tempest-VolumesActionsTest-867618192 None] Attaching volume ea354b12-5ea2-4196-9116-dcf290bacb8b to instance a2c0df87-d6ee-41f7-906b-53dc8934137a at mountpoint /dev/vdb on host None. Apr 29 17:27:49 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-8ed9b405-98e1-4447-8f61-b1e3265389b1 tempest-VolumesActionsTest-867618192 None] Attach volume completed successfully. Apr 29 17:27:49 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8ed9b405-98e1-4447-8f61-b1e3265389b1 tempest-VolumesActionsTest-867618192 None] Lock "cinder-ea354b12-5ea2-4196-9116-dcf290bacb8b" released by "attach_volume" :: held 0.184s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:27:49 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:49 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-83dad211-5bd8-4733-9888-4a8dee522869 tempest-VolumesActionsTest-867618192 None] Acquiring lock "cinder-ea354b12-5ea2-4196-9116-dcf290bacb8b-detach_volume" by "detach_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:27:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b1c49ef4-5def-4ea5-a47c-df4c347a0e72 tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945" returned: 0 in 0.841s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:49 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-b1c49ef4-5def-4ea5-a47c-df4c347a0e72 tempest-VolumesSnapshotListTestJSON-644059968 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 is being set with open permissions: ugo+rw Apr 29 17:27:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b1c49ef4-5def-4ea5-a47c-df4c347a0e72 tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:49 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 Apr 29 17:27:49 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:49 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-83dad211-5bd8-4733-9888-4a8dee522869 tempest-VolumesActionsTest-867618192 None] Lock "cinder-ea354b12-5ea2-4196-9116-dcf290bacb8b-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:27:49 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-83dad211-5bd8-4733-9888-4a8dee522869 tempest-VolumesActionsTest-867618192 None] Detaching volume ea354b12-5ea2-4196-9116-dcf290bacb8b from instance a2c0df87-d6ee-41f7-906b-53dc8934137a. Apr 29 17:27:49 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-83dad211-5bd8-4733-9888-4a8dee522869 tempest-VolumesActionsTest-867618192 None] Detach volume completed successfully. Apr 29 17:27:49 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-83dad211-5bd8-4733-9888-4a8dee522869 tempest-VolumesActionsTest-867618192 None] Lock "cinder-ea354b12-5ea2-4196-9116-dcf290bacb8b-detach_volume" released by "detach_volume" :: held 0.107s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:27:50 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b1c49ef4-5def-4ea5-a47c-df4c347a0e72 tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945" returned: 0 in 0.608s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b1c49ef4-5def-4ea5-a47c-df4c347a0e72 tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.947s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:27:50 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-b1c49ef4-5def-4ea5-a47c-df4c347a0e72 tempest-VolumesSnapshotListTestJSON-644059968 None] Create snapshot completed successfully Apr 29 17:27:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-13bf16e1-ff3a-4bda-8af4-10d34c26825e tempest-VolumesSnapshotListTestJSON-644059968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:27:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-13bf16e1-ff3a-4bda-8af4-10d34c26825e tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:27:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-13bf16e1-ff3a-4bda-8af4-10d34c26825e tempest-VolumesSnapshotListTestJSON-644059968 None] Creating offline snapshot a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0 of volume 2aafe820-d467-4754-a487-7b06eab92a86 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:27:50 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[929f5f73-7ed2-4880-a6f8-c3cf64751464]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:27:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-13bf16e1-ff3a-4bda-8af4-10d34c26825e tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:51 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 Apr 29 17:27:51 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:51 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-13bf16e1-ff3a-4bda-8af4-10d34c26825e tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945" returned: 0 in 0.955s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-13bf16e1-ff3a-4bda-8af4-10d34c26825e tempest-VolumesSnapshotListTestJSON-644059968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aafe820-d467-4754-a487-7b06eab92a86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:27:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-13bf16e1-ff3a-4bda-8af4-10d34c26825e tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:51 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0 1G Apr 29 17:27:51 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:53 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-13bf16e1-ff3a-4bda-8af4-10d34c26825e tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0 1G" returned: 0 in 1.151s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-13bf16e1-ff3a-4bda-8af4-10d34c26825e tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:53 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0 Apr 29 17:27:53 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:53 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-13bf16e1-ff3a-4bda-8af4-10d34c26825e tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0" returned: 0 in 0.755s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:53 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-13bf16e1-ff3a-4bda-8af4-10d34c26825e tempest-VolumesSnapshotListTestJSON-644059968 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0 is being set with open permissions: ugo+rw Apr 29 17:27:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-13bf16e1-ff3a-4bda-8af4-10d34c26825e tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:53 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0 Apr 29 17:27:53 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:54 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-13bf16e1-ff3a-4bda-8af4-10d34c26825e tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0" returned: 0 in 0.610s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-13bf16e1-ff3a-4bda-8af4-10d34c26825e tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.563s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:27:54 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-13bf16e1-ff3a-4bda-8af4-10d34c26825e tempest-VolumesSnapshotListTestJSON-644059968 None] Create snapshot completed successfully Apr 29 17:27:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] Acquiring lock "cinder-a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:27:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:27:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] Acquiring lock "cinder-quobyte-2aafe820-d467-4754-a487-7b06eab92a86" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:27:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-quobyte-2aafe820-d467-4754-a487-7b06eab92a86" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:27:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] Acquiring lock "cinder-quobyte-a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:27:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-quobyte-a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:27:55 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] Deleting offline snapshot a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0 of volume 2aafe820-d467-4754-a487-7b06eab92a86 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:27:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] snapshot_file for this snap is: volume-2aafe820-d467-4754-a487-7b06eab92a86.a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:27:56 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a3faf4-57e2-4d60-855b-7e85b4da3a38]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:27:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:56 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0 Apr 29 17:27:56 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:56 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0" returned: 0 in 0.756s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aafe820-d467-4754-a487-7b06eab92a86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:27:56 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[85568f5f-fea0-4c1c-b38a-ae047b12472c]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:27:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:56 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 Apr 29 17:27:56 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:57 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945" returned: 0 in 0.735s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:57 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aafe820-d467-4754-a487-7b06eab92a86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:27:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:57 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0 Apr 29 17:27:57 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:58 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0" returned: 0 in 0.920s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:27:58 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0 Apr 29 17:27:58 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:27:59 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Apr 29 17:27:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0" returned: 0 in 0.760s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:27:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-quobyte-a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0" released by "_delete_snapshot" :: held 3.297s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:27:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-quobyte-2aafe820-d467-4754-a487-7b06eab92a86" released by "delete_snapshot" :: held 3.327s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:27:59 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] Created reservations ['19582fa6-3b3f-4a3e-a490-1c550d165d37', '9885033e-c7e6-4c27-8331-7924486972b8', '6945d323-5c9d-41b7-9fd0-942faf082fcf', 'e442374f-c159-4669-a1d8-b95801996f16'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:27:59 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] Delete snapshot completed successfully. Apr 29 17:27:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-b23727eb-8c90-4ed0-ba33-02dbdeefbe97 tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-a758bd8c-a5f5-48f4-8a03-5ac7e30e22d0-delete_snapshot" released by "delete_snapshot" :: held 3.517s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:28:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f62d0b3d-cc1b-463e-9b6a-ca8652981c89 tempest-VolumesActionsTest-867618192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:28:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f62d0b3d-cc1b-463e-9b6a-ca8652981c89 tempest-VolumesActionsTest-867618192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:28:00 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[048b7945-0909-46cb-9f82-0a2eea4322c9]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:28:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f62d0b3d-cc1b-463e-9b6a-ca8652981c89 tempest-VolumesActionsTest-867618192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:00 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b Apr 29 17:28:00 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] Acquiring lock "cinder-45edfbab-a86b-4086-aca6-cec56103a945-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:28:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-45edfbab-a86b-4086-aca6-cec56103a945-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:28:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] Acquiring lock "cinder-quobyte-2aafe820-d467-4754-a487-7b06eab92a86" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:28:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-quobyte-2aafe820-d467-4754-a487-7b06eab92a86" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:28:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] Acquiring lock "cinder-quobyte-45edfbab-a86b-4086-aca6-cec56103a945" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:28:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-quobyte-45edfbab-a86b-4086-aca6-cec56103a945" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:28:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] Deleting offline snapshot 45edfbab-a86b-4086-aca6-cec56103a945 of volume 2aafe820-d467-4754-a487-7b06eab92a86 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:28:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] snapshot_file for this snap is: volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:28:00 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b669c390-9a02-4ba8-b602-a110e1c40c1a]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:28:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:00 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 Apr 29 17:28:00 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:00 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f62d0b3d-cc1b-463e-9b6a-ca8652981c89 tempest-VolumesActionsTest-867618192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b" returned: 0 in 0.819s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:00 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53042a7-6d03-4af8-98e6-b874885b3f42]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:28:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f62d0b3d-cc1b-463e-9b6a-ca8652981c89 tempest-VolumesActionsTest-867618192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:00 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b Apr 29 17:28:00 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:01 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945" returned: 0 in 0.797s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aafe820-d467-4754-a487-7b06eab92a86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:28:01 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07bf058-d665-40fc-b985-f12f4ad16712]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:28:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:01 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e Apr 29 17:28:01 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:01 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-fe98de26-a83c-4c96-abfa-71e89ca06f4c req-a0c09040-2b74-4487-9aab-13ad276910da tempest-TestMinimumBasicScenario-184983317 None] Terminate volume connection completed successfully. Apr 29 17:28:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-fe98de26-a83c-4c96-abfa-71e89ca06f4c req-a0c09040-2b74-4487-9aab-13ad276910da tempest-TestMinimumBasicScenario-184983317 None] Deleting attachment 8a5341c9-7dc3-470f-988e-d313f0c4fdf3. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:28:01 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f62d0b3d-cc1b-463e-9b6a-ca8652981c89 tempest-VolumesActionsTest-867618192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b" returned: 0 in 1.066s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f62d0b3d-cc1b-463e-9b6a-ca8652981c89 tempest-VolumesActionsTest-867618192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b /opt/stack/data/cinder/conversion/ea354b12-5ea2-4196-9116-dcf290bacb8b.temp_image.f30f1d3b-4df6-46ef-910f-a76f0cecc7a8h7elsnjv.img {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:01 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b /opt/stack/data/cinder/conversion/ea354b12-5ea2-4196-9116-dcf290bacb8b.temp_image.f30f1d3b-4df6-46ef-910f-a76f0cecc7a8h7elsnjv.img Apr 29 17:28:01 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:02 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e" returned: 0 in 0.927s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aafe820-d467-4754-a487-7b06eab92a86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:28:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:02 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 Apr 29 17:28:02 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:03 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945" returned: 0 in 1.624s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:03 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945 Apr 29 17:28:03 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-cee2e658-f8cd-4183-a50d-8b3c4481a96d tempest-TestMinimumBasicScenario-184983317 None] Acquiring lock "cinder-8745bde7-3b68-4a77-918d-c254811904de-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:28:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-cee2e658-f8cd-4183-a50d-8b3c4481a96d tempest-TestMinimumBasicScenario-184983317 None] Lock "cinder-8745bde7-3b68-4a77-918d-c254811904de-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:28:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-cee2e658-f8cd-4183-a50d-8b3c4481a96d tempest-TestMinimumBasicScenario-184983317 None] Acquiring lock "cinder-quobyte-8745bde7-3b68-4a77-918d-c254811904de" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:28:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-cee2e658-f8cd-4183-a50d-8b3c4481a96d tempest-TestMinimumBasicScenario-184983317 None] Lock "cinder-quobyte-8745bde7-3b68-4a77-918d-c254811904de" acquired by "delete_volume" :: waited 0.038s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:28:04 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9e8087-d434-42c6-ba51-38ca9dab79da]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:28:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-cee2e658-f8cd-4183-a50d-8b3c4481a96d tempest-TestMinimumBasicScenario-184983317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8745bde7-3b68-4a77-918d-c254811904de {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:05 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8745bde7-3b68-4a77-918d-c254811904de Apr 29 17:28:05 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:05 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.45edfbab-a86b-4086-aca6-cec56103a945" returned: 0 in 1.445s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-quobyte-45edfbab-a86b-4086-aca6-cec56103a945" released by "_delete_snapshot" :: held 4.948s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:28:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-quobyte-2aafe820-d467-4754-a487-7b06eab92a86" released by "delete_snapshot" :: held 4.992s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:28:05 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] Created reservations ['02857e14-b5da-41f4-8d2d-d8370f495d7a', 'a20b47f9-32ce-47b7-861d-a1ceea95d943', 'cf15c080-1a9e-45c8-bbac-46ba26c257e3', '1fe80d1c-c9e9-4be1-82d1-e9d58aae42ef'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:28:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:28:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:28:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:28:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:28:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:28:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:28:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:05 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:28:05 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:05 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] Delete snapshot completed successfully. Apr 29 17:28:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-013c26d0-2043-44fc-8fc4-9b3e6dfe0845 tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-45edfbab-a86b-4086-aca6-cec56103a945-delete_snapshot" released by "delete_snapshot" :: held 5.477s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:28:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] Acquiring lock "cinder-db8c11b8-bf53-40d6-a59b-beae107bc89e-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:28:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-db8c11b8-bf53-40d6-a59b-beae107bc89e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:28:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] Acquiring lock "cinder-quobyte-2aafe820-d467-4754-a487-7b06eab92a86" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:28:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-quobyte-2aafe820-d467-4754-a487-7b06eab92a86" acquired by "delete_snapshot" :: waited 0.047s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:28:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] Acquiring lock "cinder-quobyte-db8c11b8-bf53-40d6-a59b-beae107bc89e" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:28:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-quobyte-db8c11b8-bf53-40d6-a59b-beae107bc89e" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:28:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] Deleting offline snapshot db8c11b8-bf53-40d6-a59b-beae107bc89e of volume 2aafe820-d467-4754-a487-7b06eab92a86 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:28:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] snapshot_file for this snap is: volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:28:06 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81e59a6-c42d-4194-9d9c-48bdf2208b13]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:28:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:06 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-cee2e658-f8cd-4183-a50d-8b3c4481a96d tempest-TestMinimumBasicScenario-184983317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8745bde7-3b68-4a77-918d-c254811904de" returned: 0 in 1.804s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-cee2e658-f8cd-4183-a50d-8b3c4481a96d tempest-TestMinimumBasicScenario-184983317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8745bde7-3b68-4a77-918d-c254811904de {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:06 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8745bde7-3b68-4a77-918d-c254811904de Apr 29 17:28:06 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:06 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e Apr 29 17:28:06 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:06 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.117s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:28:08 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-cee2e658-f8cd-4183-a50d-8b3c4481a96d tempest-TestMinimumBasicScenario-184983317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8745bde7-3b68-4a77-918d-c254811904de" returned: 0 in 1.472s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-cee2e658-f8cd-4183-a50d-8b3c4481a96d tempest-TestMinimumBasicScenario-184983317 None] Lock "cinder-quobyte-8745bde7-3b68-4a77-918d-c254811904de" released by "delete_volume" :: held 3.377s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-cee2e658-f8cd-4183-a50d-8b3c4481a96d tempest-TestMinimumBasicScenario-184983317 None] Created reservations ['f3539bbf-5ae4-48c1-ab4f-193ec8a00150', 'd28861fe-4918-417f-95cd-8e5402202163', '98e34407-571c-4461-871a-bf86211ea6fd', '259699d9-74d6-40bb-a213-6ddada8bd030'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:28:08 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e" returned: 0 in 1.921s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aafe820-d467-4754-a487-7b06eab92a86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f789547-6047-42df-9b30-f14c2ae0887c]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:08 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f62d0b3d-cc1b-463e-9b6a-ca8652981c89 tempest-VolumesActionsTest-867618192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b /opt/stack/data/cinder/conversion/ea354b12-5ea2-4196-9116-dcf290bacb8b.temp_image.f30f1d3b-4df6-46ef-910f-a76f0cecc7a8h7elsnjv.img" returned: 0 in 6.424s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-cee2e658-f8cd-4183-a50d-8b3c4481a96d tempest-TestMinimumBasicScenario-184983317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-cee2e658-f8cd-4183-a50d-8b3c4481a96d tempest-TestMinimumBasicScenario-184983317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-cee2e658-f8cd-4183-a50d-8b3c4481a96d tempest-TestMinimumBasicScenario-184983317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-cee2e658-f8cd-4183-a50d-8b3c4481a96d tempest-TestMinimumBasicScenario-184983317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-cee2e658-f8cd-4183-a50d-8b3c4481a96d tempest-TestMinimumBasicScenario-184983317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-cee2e658-f8cd-4183-a50d-8b3c4481a96d tempest-TestMinimumBasicScenario-184983317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[87eb530b-74b1-41fe-b5d7-0bdfb0263833]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f62d0b3d-cc1b-463e-9b6a-ca8652981c89 tempest-VolumesActionsTest-867618192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:08 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:28:08 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:28:08 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86 Apr 29 17:28:08 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Flow 'volume_create_manager' (70036870-12b5-46a7-9d62-6eceed3a7f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72b4174-95cb-463e-bc7a-73eda21a95c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:28:08 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b Apr 29 17:28:08 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72b4174-95cb-463e-bc7a-73eda21a95c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-624886773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed36c06f-dd9a-437f-80ff-9afbaa9f683d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9058d75fb82f4f658e87a3705c475e4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:28:08Z,use_quota=True,user_id='0ae5dab6d01b4afc88524345688f8c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3549ef4e-6b83-44fe-be5f-e086b1bd4d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3549ef4e-6b83-44fe-be5f-e086b1bd4d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86bee9d1-ca71-4823-a2b1-d83e2d925f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86bee9d1-ca71-4823-a2b1-d83e2d925f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed36c06f-dd9a-437f-80ff-9afbaa9f683d', 'volume_name': 'volume-ed36c06f-dd9a-437f-80ff-9afbaa9f683d', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e4e34b-85ac-4d32-b4b2-5f55bdeb8ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e4e34b-85ac-4d32-b4b2-5f55bdeb8ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (512bd1dc-53f2-468f-925c-b930976f01e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:28:08 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Volume ed36c06f-dd9a-437f-80ff-9afbaa9f683d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed36c06f-dd9a-437f-80ff-9afbaa9f683d', 'volume_size': 1} Apr 29 17:28:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:28:09 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-cee2e658-f8cd-4183-a50d-8b3c4481a96d tempest-TestMinimumBasicScenario-184983317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.653s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:09 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-cee2e658-f8cd-4183-a50d-8b3c4481a96d tempest-TestMinimumBasicScenario-184983317 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:28:09 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-cee2e658-f8cd-4183-a50d-8b3c4481a96d tempest-TestMinimumBasicScenario-184983317 None] Deleted volume successfully. Apr 29 17:28:09 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-cee2e658-f8cd-4183-a50d-8b3c4481a96d tempest-TestMinimumBasicScenario-184983317 None] Lock "cinder-8745bde7-3b68-4a77-918d-c254811904de-delete_volume" released by "delete_volume" :: held 4.523s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:28:09 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86" returned: 0 in 0.893s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:09 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e Apr 29 17:28:09 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:09 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f62d0b3d-cc1b-463e-9b6a-ca8652981c89 tempest-VolumesActionsTest-867618192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b" returned: 0 in 0.977s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:09 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-f62d0b3d-cc1b-463e-9b6a-ca8652981c89 tempest-VolumesActionsTest-867618192 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b, size 1024.00 MB, duration 6.43 sec, destination /opt/stack/data/cinder/conversion/ea354b12-5ea2-4196-9116-dcf290bacb8b.temp_image.f30f1d3b-4df6-46ef-910f-a76f0cecc7a8h7elsnjv.img {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:28:09 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-f62d0b3d-cc1b-463e-9b6a-ca8652981c89 tempest-VolumesActionsTest-867618192 None] Converted 1024.00 MB image at 159.38 MB/s Apr 29 17:28:09 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-f62d0b3d-cc1b-463e-9b6a-ca8652981c89 tempest-VolumesActionsTest-867618192 None] f30f1d3b-4df6-46ef-910f-a76f0cecc7a8 was raw, no need to convert to raw {{(pid=84547) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 29 17:28:09 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e" returned: 0 in 0.803s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:10 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e Apr 29 17:28:10 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:10 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86.db8c11b8-bf53-40d6-a59b-beae107bc89e" returned: 0 in 0.803s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:10 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-quobyte-db8c11b8-bf53-40d6-a59b-beae107bc89e" released by "_delete_snapshot" :: held 4.634s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:28:10 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-quobyte-2aafe820-d467-4754-a487-7b06eab92a86" released by "delete_snapshot" :: held 4.694s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:28:10 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] Created reservations ['97845125-2b92-46f6-92bd-a10281b8edbc', '0790a8b5-654c-4a08-9202-a5f132eaf6d3', 'b44d102f-a493-408b-a18a-a561b0c493bf', '536324b9-5753-4914-b682-afdb913fca75'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:28:10 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] Delete snapshot completed successfully. Apr 29 17:28:10 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f930d7dc-95c8-459c-bf11-788faaa89c41 tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-db8c11b8-bf53-40d6-a59b-beae107bc89e-delete_snapshot" released by "delete_snapshot" :: held 4.895s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:28:11 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6e4580cf-e0df-40a1-9132-0e836f46051f tempest-VolumesSnapshotListTestJSON-644059968 None] Acquiring lock "cinder-2aafe820-d467-4754-a487-7b06eab92a86-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:28:11 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6e4580cf-e0df-40a1-9132-0e836f46051f tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-2aafe820-d467-4754-a487-7b06eab92a86-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:28:11 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6e4580cf-e0df-40a1-9132-0e836f46051f tempest-VolumesSnapshotListTestJSON-644059968 None] Acquiring lock "cinder-quobyte-2aafe820-d467-4754-a487-7b06eab92a86" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:28:11 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6e4580cf-e0df-40a1-9132-0e836f46051f tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-quobyte-2aafe820-d467-4754-a487-7b06eab92a86" acquired by "delete_volume" :: waited 0.025s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:28:11 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee099f9-cd5e-42e2-931f-e8083c668697]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:28:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6e4580cf-e0df-40a1-9132-0e836f46051f tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:11 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86 Apr 29 17:28:11 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:12 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6e4580cf-e0df-40a1-9132-0e836f46051f tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86" returned: 0 in 0.981s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6e4580cf-e0df-40a1-9132-0e836f46051f tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:12 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86 Apr 29 17:28:12 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:13 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6e4580cf-e0df-40a1-9132-0e836f46051f tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2aafe820-d467-4754-a487-7b06eab92a86" returned: 0 in 0.709s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:13 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6e4580cf-e0df-40a1-9132-0e836f46051f tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-quobyte-2aafe820-d467-4754-a487-7b06eab92a86" released by "delete_volume" :: held 1.756s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:28:13 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-6e4580cf-e0df-40a1-9132-0e836f46051f tempest-VolumesSnapshotListTestJSON-644059968 None] Created reservations ['94c6669f-5238-46bc-9dc0-eac9acba84c5', '170f34b8-a609-494c-a495-fbd4c8b7aa39', '4248548f-17ec-46ff-9e3b-d1b9eed42fa1', 'b84fedb4-7345-4a8e-9cdc-794184af254d'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:28:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6e4580cf-e0df-40a1-9132-0e836f46051f tempest-VolumesSnapshotListTestJSON-644059968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:28:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6e4580cf-e0df-40a1-9132-0e836f46051f tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:28:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-6e4580cf-e0df-40a1-9132-0e836f46051f tempest-VolumesSnapshotListTestJSON-644059968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:28:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-6e4580cf-e0df-40a1-9132-0e836f46051f tempest-VolumesSnapshotListTestJSON-644059968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:28:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6e4580cf-e0df-40a1-9132-0e836f46051f tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:28:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6e4580cf-e0df-40a1-9132-0e836f46051f tempest-VolumesSnapshotListTestJSON-644059968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:13 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:28:13 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:14 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6e4580cf-e0df-40a1-9132-0e836f46051f tempest-VolumesSnapshotListTestJSON-644059968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.832s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:14 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-6e4580cf-e0df-40a1-9132-0e836f46051f tempest-VolumesSnapshotListTestJSON-644059968 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:28:14 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-6e4580cf-e0df-40a1-9132-0e836f46051f tempest-VolumesSnapshotListTestJSON-644059968 None] Deleted volume successfully. Apr 29 17:28:14 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6e4580cf-e0df-40a1-9132-0e836f46051f tempest-VolumesSnapshotListTestJSON-644059968 None] Lock "cinder-2aafe820-d467-4754-a487-7b06eab92a86-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:28:23 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:INSERT=15,cinder:SELECT=66,cinder:UPDATE=47,cinder:DELETE=3 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:28:24 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=48,cinder:INSERT=15,cinder:UPDATE=61,cinder:DELETE=4 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:28:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f62d0b3d-cc1b-463e-9b6a-ca8652981c89 tempest-VolumesActionsTest-867618192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.493s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:28:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f62d0b3d-cc1b-463e-9b6a-ca8652981c89 tempest-VolumesActionsTest-867618192 None] Uploaded volume to glance image-id: f30f1d3b-4df6-46ef-910f-a76f0cecc7a8. {{(pid=84547) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 29 17:28:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.897s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:28:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-624886773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed36c06f-dd9a-437f-80ff-9afbaa9f683d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9058d75fb82f4f658e87a3705c475e4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:28:08Z,use_quota=True,user_id='0ae5dab6d01b4afc88524345688f8c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:28:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Creating volume ed36c06f-dd9a-437f-80ff-9afbaa9f683d {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:28:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:28:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:28:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:28:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:28:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:28:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:28:33 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:28:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ed36c06f-dd9a-437f-80ff-9afbaa9f683d 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:33 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f62d0b3d-cc1b-463e-9b6a-ca8652981c89 tempest-VolumesActionsTest-867618192 None] Copy volume to image completed successfully. Apr 29 17:28:33 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ed36c06f-dd9a-437f-80ff-9afbaa9f683d 1073741824 Apr 29 17:28:33 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:34 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ed36c06f-dd9a-437f-80ff-9afbaa9f683d 1073741824" returned: 0 in 0.999s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ed36c06f-dd9a-437f-80ff-9afbaa9f683d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:34 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ed36c06f-dd9a-437f-80ff-9afbaa9f683d Apr 29 17:28:34 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:28:35 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ed36c06f-dd9a-437f-80ff-9afbaa9f683d" returned: 0 in 0.719s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:35 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:28:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:28:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.592s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:28:35 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (512bd1dc-53f2-468f-925c-b930976f01e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed36c06f-dd9a-437f-80ff-9afbaa9f683d', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:28:35 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5316b5-0ca1-43a4-b291-93d21e45adcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:28:35 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[94885806-c5e3-4f9c-8bac-1bf4a38ce839]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:28:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:35 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Volume volume-ed36c06f-dd9a-437f-80ff-9afbaa9f683d (ed36c06f-dd9a-437f-80ff-9afbaa9f683d): created successfully Apr 29 17:28:35 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5316b5-0ca1-43a4-b291-93d21e45adcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:28:35 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Flow 'volume_create_manager' (70036870-12b5-46a7-9d62-6eceed3a7f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:28:35 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ce00317e-afdc-4ead-ba9e-e7cf8cddbc70 tempest-AttachVolumeNegativeTest-698092894 None] Created volume successfully. Apr 29 17:28:35 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b Apr 29 17:28:35 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:36 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b" returned: 0 in 0.892s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:36 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[8977be84-549f-4358-a644-e77ef8d2f558]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:28:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:36 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b Apr 29 17:28:36 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:37 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b" returned: 0 in 0.839s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b /opt/stack/data/cinder/conversion/ea354b12-5ea2-4196-9116-dcf290bacb8b.temp_image.10a12576-a2f5-4b1e-b99b-6235bdc678c1wkbb5ymw.img {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:37 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b /opt/stack/data/cinder/conversion/ea354b12-5ea2-4196-9116-dcf290bacb8b.temp_image.10a12576-a2f5-4b1e-b99b-6235bdc678c1wkbb5ymw.img Apr 29 17:28:37 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-56382001-c31d-4b70-a0f7-e45eb7a8aea0 req-aa72482c-e968-4549-92cb-c58a72adf77a tempest-AttachVolumeNegativeTest-698092894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:28:43 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b /opt/stack/data/cinder/conversion/ea354b12-5ea2-4196-9116-dcf290bacb8b.temp_image.10a12576-a2f5-4b1e-b99b-6235bdc678c1wkbb5ymw.img" returned: 0 in 6.311s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:43 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[408d2700-6c07-4246-aaa6-2b1f87ed2518]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:28:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:43 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b Apr 29 17:28:43 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:44 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b" returned: 0 in 1.055s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:44 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b, size 1024.00 MB, duration 6.31 sec, destination /opt/stack/data/cinder/conversion/ea354b12-5ea2-4196-9116-dcf290bacb8b.temp_image.10a12576-a2f5-4b1e-b99b-6235bdc678c1wkbb5ymw.img {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:28:44 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] Converted 1024.00 MB image at 162.20 MB/s Apr 29 17:28:44 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] 10a12576-a2f5-4b1e-b99b-6235bdc678c1 was raw, converting to qcow2 {{(pid=84547) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 29 17:28:44 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abbbae7-514b-4f8d-aa02-13df4d9631d2]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:28:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ea354b12-5ea2-4196-9116-dcf290bacb8b.temp_image.10a12576-a2f5-4b1e-b99b-6235bdc678c1wkbb5ymw.img {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:44 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ea354b12-5ea2-4196-9116-dcf290bacb8b.temp_image.10a12576-a2f5-4b1e-b99b-6235bdc678c1wkbb5ymw.img Apr 29 17:28:44 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:45 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ea354b12-5ea2-4196-9116-dcf290bacb8b.temp_image.10a12576-a2f5-4b1e-b99b-6235bdc678c1wkbb5ymw.img" returned: 0 in 0.762s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ea354b12-5ea2-4196-9116-dcf290bacb8b.temp_image.10a12576-a2f5-4b1e-b99b-6235bdc678c1wkbb5ymw.img {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:45 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ea354b12-5ea2-4196-9116-dcf290bacb8b.temp_image.10a12576-a2f5-4b1e-b99b-6235bdc678c1wkbb5ymw.img Apr 29 17:28:45 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:46 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ea354b12-5ea2-4196-9116-dcf290bacb8b.temp_image.10a12576-a2f5-4b1e-b99b-6235bdc678c1wkbb5ymw.img" returned: 1 in 0.796s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ea354b12-5ea2-4196-9116-dcf290bacb8b.temp_image.10a12576-a2f5-4b1e-b99b-6235bdc678c1wkbb5ymw.img' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:28:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ea354b12-5ea2-4196-9116-dcf290bacb8b.temp_image.10a12576-a2f5-4b1e-b99b-6235bdc678c1wkbb5ymw.img /opt/stack/data/cinder/conversion/vol_upload_pd_as65y {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:46 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ea354b12-5ea2-4196-9116-dcf290bacb8b.temp_image.10a12576-a2f5-4b1e-b99b-6235bdc678c1wkbb5ymw.img /opt/stack/data/cinder/conversion/vol_upload_pd_as65y Apr 29 17:28:46 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:46 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ea354b12-5ea2-4196-9116-dcf290bacb8b.temp_image.10a12576-a2f5-4b1e-b99b-6235bdc678c1wkbb5ymw.img /opt/stack/data/cinder/conversion/vol_upload_pd_as65y" returned: 0 in 0.740s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:46 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] Image conversion details: src /opt/stack/data/cinder/conversion/ea354b12-5ea2-4196-9116-dcf290bacb8b.temp_image.10a12576-a2f5-4b1e-b99b-6235bdc678c1wkbb5ymw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_pd_as65y {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:28:46 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 29 17:28:46 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cafecf-0e03-410d-91fd-eb7282e090c7]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:28:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pd_as65y {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:46 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pd_as65y Apr 29 17:28:46 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:47 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pd_as65y" returned: 0 in 0.790s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.971s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:28:49 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] Uploaded volume to glance image-id: 10a12576-a2f5-4b1e-b99b-6235bdc678c1. {{(pid=84547) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 29 17:28:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-56382001-c31d-4b70-a0f7-e45eb7a8aea0 req-aa72482c-e968-4549-92cb-c58a72adf77a tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.648s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:28:49 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7577a4-1935-4259-a77c-e4c74e560b1c]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:28:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-56382001-c31d-4b70-a0f7-e45eb7a8aea0 req-aa72482c-e968-4549-92cb-c58a72adf77a tempest-AttachVolumeNegativeTest-698092894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ed36c06f-dd9a-437f-80ff-9afbaa9f683d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:49 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-c3b00e7f-58d1-40f0-a745-7152bd79a3fe tempest-VolumesActionsTest-867618192 None] Copy volume to image completed successfully. Apr 29 17:28:49 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ed36c06f-dd9a-437f-80ff-9afbaa9f683d Apr 29 17:28:49 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:50 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-56382001-c31d-4b70-a0f7-e45eb7a8aea0 req-aa72482c-e968-4549-92cb-c58a72adf77a tempest-AttachVolumeNegativeTest-698092894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ed36c06f-dd9a-437f-80ff-9afbaa9f683d" returned: 0 in 0.953s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-56382001-c31d-4b70-a0f7-e45eb7a8aea0 req-aa72482c-e968-4549-92cb-c58a72adf77a tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.982s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:28:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-56382001-c31d-4b70-a0f7-e45eb7a8aea0 req-aa72482c-e968-4549-92cb-c58a72adf77a tempest-AttachVolumeNegativeTest-698092894 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-ed36c06f-dd9a-437f-80ff-9afbaa9f683d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12d156d4-a1b1-48c6-b5e8-a8d19fefb405', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:28:50 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-56382001-c31d-4b70-a0f7-e45eb7a8aea0 req-aa72482c-e968-4549-92cb-c58a72adf77a tempest-AttachVolumeNegativeTest-698092894 None] attachment_update completed successfully. Apr 29 17:28:50 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-68f8fa36-d06b-4075-b5a8-567f41cff07b tempest-VolumesActionsTest-867618192 None] Acquiring lock "cinder-ea354b12-5ea2-4196-9116-dcf290bacb8b-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:28:50 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-68f8fa36-d06b-4075-b5a8-567f41cff07b tempest-VolumesActionsTest-867618192 None] Lock "cinder-ea354b12-5ea2-4196-9116-dcf290bacb8b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:28:50 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-68f8fa36-d06b-4075-b5a8-567f41cff07b tempest-VolumesActionsTest-867618192 None] Acquiring lock "cinder-quobyte-ea354b12-5ea2-4196-9116-dcf290bacb8b" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:28:50 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-68f8fa36-d06b-4075-b5a8-567f41cff07b tempest-VolumesActionsTest-867618192 None] Lock "cinder-quobyte-ea354b12-5ea2-4196-9116-dcf290bacb8b" acquired by "delete_volume" :: waited 0.022s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:28:50 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad75db3a-450a-4958-9c6d-4c576544e4f6]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:28:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-68f8fa36-d06b-4075-b5a8-567f41cff07b tempest-VolumesActionsTest-867618192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:50 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b Apr 29 17:28:50 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:51 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-68f8fa36-d06b-4075-b5a8-567f41cff07b tempest-VolumesActionsTest-867618192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b" returned: 0 in 0.892s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-68f8fa36-d06b-4075-b5a8-567f41cff07b tempest-VolumesActionsTest-867618192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:51 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b Apr 29 17:28:51 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:52 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-68f8fa36-d06b-4075-b5a8-567f41cff07b tempest-VolumesActionsTest-867618192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ea354b12-5ea2-4196-9116-dcf290bacb8b" returned: 0 in 0.722s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-68f8fa36-d06b-4075-b5a8-567f41cff07b tempest-VolumesActionsTest-867618192 None] Lock "cinder-quobyte-ea354b12-5ea2-4196-9116-dcf290bacb8b" released by "delete_volume" :: held 1.682s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:28:52 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-68f8fa36-d06b-4075-b5a8-567f41cff07b tempest-VolumesActionsTest-867618192 None] Created reservations ['4033af01-cb45-4915-9a3d-dabcd4dc10f7', 'a7eefd8a-8c26-4ce1-a38a-e09d4ac2c6cf', 'b6595ccf-ac85-4de4-848a-c492d7084f76', '774638e6-3933-42a5-b047-46c6a5e70c0a'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:28:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-68f8fa36-d06b-4075-b5a8-567f41cff07b tempest-VolumesActionsTest-867618192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:28:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-68f8fa36-d06b-4075-b5a8-567f41cff07b tempest-VolumesActionsTest-867618192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:28:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-68f8fa36-d06b-4075-b5a8-567f41cff07b tempest-VolumesActionsTest-867618192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:28:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-68f8fa36-d06b-4075-b5a8-567f41cff07b tempest-VolumesActionsTest-867618192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:28:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-68f8fa36-d06b-4075-b5a8-567f41cff07b tempest-VolumesActionsTest-867618192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:28:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-68f8fa36-d06b-4075-b5a8-567f41cff07b tempest-VolumesActionsTest-867618192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:28:52 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:28:52 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:28:53 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Apr 29 17:28:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-68f8fa36-d06b-4075-b5a8-567f41cff07b tempest-VolumesActionsTest-867618192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.745s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:28:53 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-68f8fa36-d06b-4075-b5a8-567f41cff07b tempest-VolumesActionsTest-867618192 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:28:53 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-68f8fa36-d06b-4075-b5a8-567f41cff07b tempest-VolumesActionsTest-867618192 None] Deleted volume successfully. Apr 29 17:28:53 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-68f8fa36-d06b-4075-b5a8-567f41cff07b tempest-VolumesActionsTest-867618192 None] Lock "cinder-ea354b12-5ea2-4196-9116-dcf290bacb8b-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:28:57 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-79a811f5-af2d-4f30-9fbf-7cc32b69ccc0 req-ee2c8961-6904-4463-8b63-c747fefcbee2 tempest-AttachVolumeNegativeTest-698092894 None] Terminate volume connection completed successfully. Apr 29 17:28:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-79a811f5-af2d-4f30-9fbf-7cc32b69ccc0 req-ee2c8961-6904-4463-8b63-c747fefcbee2 tempest-AttachVolumeNegativeTest-698092894 None] Deleting attachment 12d156d4-a1b1-48c6-b5e8-a8d19fefb405. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:29:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:29:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:29:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:29:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:05 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:29:05 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:06 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.914s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Flow 'volume_create_manager' (2084a21d-e4cb-4bc3-ba5d-f66099c444b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0cddaef-69e0-46d1-b38b-33ec580d9fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0cddaef-69e0-46d1-b38b-33ec580d9fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-903688050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55594c40-18ec-40f7-b8fb-51ac2006ee0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701f72f0b5224652b0a6ac47ef0f7055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:29:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:29:07Z,use_quota=True,user_id='93c39a620e364b7a84d3d2a1b2acb004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eedd29c8-47e6-4ca1-8c92-0985fed159be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eedd29c8-47e6-4ca1-8c92-0985fed159be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7873533-165e-477a-b64b-f22f51d89540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7873533-165e-477a-b64b-f22f51d89540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55594c40-18ec-40f7-b8fb-51ac2006ee0e', 'volume_name': 'volume-55594c40-18ec-40f7-b8fb-51ac2006ee0e', 'volume_size': 2}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e4856e-9094-4631-92e3-c098b5701c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e4856e-9094-4631-92e3-c098b5701c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9beb940-be33-4cb6-9dfc-4c6c6ab1474d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:07 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Volume 55594c40-18ec-40f7-b8fb-51ac2006ee0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55594c40-18ec-40f7-b8fb-51ac2006ee0e', 'volume_size': 2} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-903688050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55594c40-18ec-40f7-b8fb-51ac2006ee0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701f72f0b5224652b0a6ac47ef0f7055',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:29:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:29:07Z,use_quota=True,user_id='93c39a620e364b7a84d3d2a1b2acb004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Creating volume 55594c40-18ec-40f7-b8fb-51ac2006ee0e {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:29:07 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-55594c40-18ec-40f7-b8fb-51ac2006ee0e 2147483648 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:07 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-55594c40-18ec-40f7-b8fb-51ac2006ee0e 2147483648 Apr 29 17:29:07 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Flow 'volume_create_manager' (20104828-3be0-4edc-b0f1-018abd54e287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7120ea1-8f71-4b3f-a4d1-02508447a1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7120ea1-8f71-4b3f-a4d1-02508447a1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-238147443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd3193e-fb20-4262-bb8d-686960ab3308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2ab09ce7e74e18bf862c0bcb16f595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:29:07Z,use_quota=True,user_id='75a25b81d53c42bf964508bc615a80d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8b62bb-b095-4d79-a63c-6d929943d8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8b62bb-b095-4d79-a63c-6d929943d8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b415c9a-c2bd-48a5-9847-cbe6ef092061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b415c9a-c2bd-48a5-9847-cbe6ef092061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bd3193e-fb20-4262-bb8d-686960ab3308', 'volume_name': 'volume-4bd3193e-fb20-4262-bb8d-686960ab3308', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27988609-bc41-4936-a1fb-1f74783b4f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27988609-bc41-4936-a1fb-1f74783b4f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf25258-2c73-4027-9e7d-720f3fc095dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:07 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Volume 4bd3193e-fb20-4262-bb8d-686960ab3308: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bd3193e-fb20-4262-bb8d-686960ab3308', 'volume_size': 1} Apr 29 17:29:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:08 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-55594c40-18ec-40f7-b8fb-51ac2006ee0e 2147483648" returned: 0 in 1.579s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-55594c40-18ec-40f7-b8fb-51ac2006ee0e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:08 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-55594c40-18ec-40f7-b8fb-51ac2006ee0e Apr 29 17:29:08 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:09 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-55594c40-18ec-40f7-b8fb-51ac2006ee0e" returned: 0 in 0.937s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] <== create_volume: return (2642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:29:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.644s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.427s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-238147443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd3193e-fb20-4262-bb8d-686960ab3308,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2ab09ce7e74e18bf862c0bcb16f595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:29:07Z,use_quota=True,user_id='75a25b81d53c42bf964508bc615a80d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:29:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Creating volume 4bd3193e-fb20-4262-bb8d-686960ab3308 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:29:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:29:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:29:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:29:09 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:29:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9beb940-be33-4cb6-9dfc-4c6c6ab1474d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55594c40-18ec-40f7-b8fb-51ac2006ee0e', 'volume_size': 2}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7d4e59-1d35-4af4-9f43-2a877258c2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:09 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 1073741824 Apr 29 17:29:09 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:09 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Volume volume-55594c40-18ec-40f7-b8fb-51ac2006ee0e (55594c40-18ec-40f7-b8fb-51ac2006ee0e): created successfully Apr 29 17:29:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7d4e59-1d35-4af4-9f43-2a877258c2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Flow 'volume_create_manager' (2084a21d-e4cb-4bc3-ba5d-f66099c444b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:29:09 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-9b85cde0-c37d-4258-9b75-d631718b1fd7 tempest-VolumesCloneNegativeTest-1466688055 None] Created volume successfully. Apr 29 17:29:10 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e57e7a1e-f4ed-4d8c-8648-62cc05987bd9 tempest-VolumesCloneNegativeTest-1466688055 None] Acquiring lock "cinder-55594c40-18ec-40f7-b8fb-51ac2006ee0e-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:29:10 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e57e7a1e-f4ed-4d8c-8648-62cc05987bd9 tempest-VolumesCloneNegativeTest-1466688055 None] Lock "cinder-55594c40-18ec-40f7-b8fb-51ac2006ee0e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:29:10 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e57e7a1e-f4ed-4d8c-8648-62cc05987bd9 tempest-VolumesCloneNegativeTest-1466688055 None] Acquiring lock "cinder-quobyte-55594c40-18ec-40f7-b8fb-51ac2006ee0e" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:29:10 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e57e7a1e-f4ed-4d8c-8648-62cc05987bd9 tempest-VolumesCloneNegativeTest-1466688055 None] Lock "cinder-quobyte-55594c40-18ec-40f7-b8fb-51ac2006ee0e" acquired by "delete_volume" :: waited 0.018s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:29:10 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9901fd-c482-4dfe-98f0-f434a8fdbc90]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:29:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e57e7a1e-f4ed-4d8c-8648-62cc05987bd9 tempest-VolumesCloneNegativeTest-1466688055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-55594c40-18ec-40f7-b8fb-51ac2006ee0e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:10 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-55594c40-18ec-40f7-b8fb-51ac2006ee0e Apr 29 17:29:10 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:11 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 1073741824" returned: 0 in 1.228s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:11 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 Apr 29 17:29:11 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:12 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e57e7a1e-f4ed-4d8c-8648-62cc05987bd9 tempest-VolumesCloneNegativeTest-1466688055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-55594c40-18ec-40f7-b8fb-51ac2006ee0e" returned: 0 in 1.351s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e57e7a1e-f4ed-4d8c-8648-62cc05987bd9 tempest-VolumesCloneNegativeTest-1466688055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-55594c40-18ec-40f7-b8fb-51ac2006ee0e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:12 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-55594c40-18ec-40f7-b8fb-51ac2006ee0e Apr 29 17:29:12 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:12 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308" returned: 0 in 1.281s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] <== create_volume: return (2558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:29:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.565s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf25258-2c73-4027-9e7d-720f3fc095dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd3193e-fb20-4262-bb8d-686960ab3308', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac1cfcc-9ac5-4038-9171-25c812aa8d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:12 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Volume volume-4bd3193e-fb20-4262-bb8d-686960ab3308 (4bd3193e-fb20-4262-bb8d-686960ab3308): created successfully Apr 29 17:29:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ac1cfcc-9ac5-4038-9171-25c812aa8d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Flow 'volume_create_manager' (20104828-3be0-4edc-b0f1-018abd54e287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:29:12 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-cda47190-6f88-4a3d-a728-f98ff8df0a64 tempest-TestStampPattern-1991106930 None] Created volume successfully. Apr 29 17:29:13 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e57e7a1e-f4ed-4d8c-8648-62cc05987bd9 tempest-VolumesCloneNegativeTest-1466688055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-55594c40-18ec-40f7-b8fb-51ac2006ee0e" returned: 0 in 0.981s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:13 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e57e7a1e-f4ed-4d8c-8648-62cc05987bd9 tempest-VolumesCloneNegativeTest-1466688055 None] Lock "cinder-quobyte-55594c40-18ec-40f7-b8fb-51ac2006ee0e" released by "delete_volume" :: held 2.416s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:29:13 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-e57e7a1e-f4ed-4d8c-8648-62cc05987bd9 tempest-VolumesCloneNegativeTest-1466688055 None] Created reservations ['fe8de1e2-b313-463c-81f8-71fb01751867', '6d278761-425a-4341-8022-c54750404200', '80cd6fe5-5ab9-4cc3-bcde-745d9bb60ef7', '4ce88b38-df78-492a-b86c-93632cc17946'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:29:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e57e7a1e-f4ed-4d8c-8648-62cc05987bd9 tempest-VolumesCloneNegativeTest-1466688055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e57e7a1e-f4ed-4d8c-8648-62cc05987bd9 tempest-VolumesCloneNegativeTest-1466688055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e57e7a1e-f4ed-4d8c-8648-62cc05987bd9 tempest-VolumesCloneNegativeTest-1466688055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:29:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e57e7a1e-f4ed-4d8c-8648-62cc05987bd9 tempest-VolumesCloneNegativeTest-1466688055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:29:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e57e7a1e-f4ed-4d8c-8648-62cc05987bd9 tempest-VolumesCloneNegativeTest-1466688055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e57e7a1e-f4ed-4d8c-8648-62cc05987bd9 tempest-VolumesCloneNegativeTest-1466688055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:13 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:29:13 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:14 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e57e7a1e-f4ed-4d8c-8648-62cc05987bd9 tempest-VolumesCloneNegativeTest-1466688055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.028s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:14 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-e57e7a1e-f4ed-4d8c-8648-62cc05987bd9 tempest-VolumesCloneNegativeTest-1466688055 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:29:14 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e57e7a1e-f4ed-4d8c-8648-62cc05987bd9 tempest-VolumesCloneNegativeTest-1466688055 None] Deleted volume successfully. Apr 29 17:29:14 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e57e7a1e-f4ed-4d8c-8648-62cc05987bd9 tempest-VolumesCloneNegativeTest-1466688055 None] Lock "cinder-55594c40-18ec-40f7-b8fb-51ac2006ee0e-delete_volume" released by "delete_volume" :: held 3.827s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Flow 'volume_create_manager' (5614226c-5d28-458a-a88e-3f1c07e9d03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3347782-cd16-4434-a2eb-de6c6fb2359d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3347782-cd16-4434-a2eb-de6c6fb2359d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1981467561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3234a7-77c1-4d07-9b92-7aab61b33ac2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e72e26bd250d4c3e80de6b19eb5b1cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:29:19Z,use_quota=True,user_id='16bd494f87104e7782a1d624bc7bd32a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c700b19c-e063-4248-b6a3-8aa659ef02f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c700b19c-e063-4248-b6a3-8aa659ef02f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2553f94b-0300-41ec-95bc-62f4e8983ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2553f94b-0300-41ec-95bc-62f4e8983ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae3234a7-77c1-4d07-9b92-7aab61b33ac2', 'volume_name': 'volume-ae3234a7-77c1-4d07-9b92-7aab61b33ac2', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1e266a-0669-4125-882a-62f72577f061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1e266a-0669-4125-882a-62f72577f061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8b6a99-c584-4f63-95c5-7e29e0313f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:19 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Volume ae3234a7-77c1-4d07-9b92-7aab61b33ac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae3234a7-77c1-4d07-9b92-7aab61b33ac2', 'volume_size': 1} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1981467561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3234a7-77c1-4d07-9b92-7aab61b33ac2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e72e26bd250d4c3e80de6b19eb5b1cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:29:19Z,use_quota=True,user_id='16bd494f87104e7782a1d624bc7bd32a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Creating volume ae3234a7-77c1-4d07-9b92-7aab61b33ac2 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:29:19 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:29:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ae3234a7-77c1-4d07-9b92-7aab61b33ac2 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:19 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ae3234a7-77c1-4d07-9b92-7aab61b33ac2 1073741824 Apr 29 17:29:19 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:20 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ae3234a7-77c1-4d07-9b92-7aab61b33ac2 1073741824" returned: 0 in 0.889s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ae3234a7-77c1-4d07-9b92-7aab61b33ac2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:20 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ae3234a7-77c1-4d07-9b92-7aab61b33ac2 Apr 29 17:29:20 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:20 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ae3234a7-77c1-4d07-9b92-7aab61b33ac2" returned: 0 in 0.655s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:20 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:29:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea8b6a99-c584-4f63-95c5-7e29e0313f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae3234a7-77c1-4d07-9b92-7aab61b33ac2', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a56307-e015-491e-a719-a433206f1474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:20 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Volume volume-ae3234a7-77c1-4d07-9b92-7aab61b33ac2 (ae3234a7-77c1-4d07-9b92-7aab61b33ac2): created successfully Apr 29 17:29:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a56307-e015-491e-a719-a433206f1474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Flow 'volume_create_manager' (5614226c-5d28-458a-a88e-3f1c07e9d03b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:29:20 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-1199d6af-863f-4bdc-a6a4-d24d742110b0 tempest-VolumesGetTest-921694396 None] Created volume successfully. Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Flow 'volume_create_manager' (405ece63-8929-4139-842c-397e2aaffa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4869611c-d3c9-4af9-83e5-be23363b0103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4869611c-d3c9-4af9-83e5-be23363b0103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:29:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-301061133',display_name='tempest-VolumesGetTest-Volume-1654785341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72e26bd250d4c3e80de6b19eb5b1cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:29:22Z,use_quota=True,user_id='16bd494f87104e7782a1d624bc7bd32a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de766402-675c-4058-9e85-981d60aa26d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de766402-675c-4058-9e85-981d60aa26d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b09128-5ccb-4f06-bf99-e5c19949cc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b09128-5ccb-4f06-bf99-e5c19949cc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff', 'volume_name': 'volume-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11507cbc-6c75-4208-a140-b4ae705f1684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11507cbc-6c75-4208-a140-b4ae705f1684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca55973-bd30-40d5-a281-35a974ed9676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:21 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Volume 3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff', 'volume_size': 1} Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:29:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-301061133',display_name='tempest-VolumesGetTest-Volume-1654785341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72e26bd250d4c3e80de6b19eb5b1cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:29:22Z,use_quota=True,user_id='16bd494f87104e7782a1d624bc7bd32a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Creating volume 3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:29:21 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:29:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:21 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff 1073741824 Apr 29 17:29:21 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:23 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff 1073741824" returned: 0 in 1.089s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:23 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff Apr 29 17:29:23 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:24 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff" returned: 0 in 0.912s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] <== create_volume: return (2132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:29:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.138s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca55973-bd30-40d5-a281-35a974ed9676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffd6c93-d032-4f74-af05-4597147a1c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:24 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Volume volume-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff (3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff): created successfully Apr 29 17:29:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ffd6c93-d032-4f74-af05-4597147a1c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Flow 'volume_create_manager' (405ece63-8929-4139-842c-397e2aaffa9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:29:24 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-008128eb-e304-4b6f-b65a-5bf624bf4764 tempest-VolumesGetTest-921694396 None] Created volume successfully. Apr 29 17:29:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-90ec147e-b89e-48fb-8dac-dc07b837a18b tempest-VolumesGetTest-921694396 None] Acquiring lock "cinder-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:29:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-90ec147e-b89e-48fb-8dac-dc07b837a18b tempest-VolumesGetTest-921694396 None] Lock "cinder-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:29:25 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=36,cinder:UPDATE=34,cinder:DELETE=5,cinder:INSERT=5 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:29:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-90ec147e-b89e-48fb-8dac-dc07b837a18b tempest-VolumesGetTest-921694396 None] Acquiring lock "cinder-quobyte-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:29:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-90ec147e-b89e-48fb-8dac-dc07b837a18b tempest-VolumesGetTest-921694396 None] Lock "cinder-quobyte-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff" acquired by "delete_volume" :: waited 0.038s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:29:25 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7480fbb-e35f-4fea-bbb7-612e074e663c]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:29:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-90ec147e-b89e-48fb-8dac-dc07b837a18b tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:25 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff Apr 29 17:29:25 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:26 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-90ec147e-b89e-48fb-8dac-dc07b837a18b tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff" returned: 0 in 0.945s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-90ec147e-b89e-48fb-8dac-dc07b837a18b tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:26 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff Apr 29 17:29:26 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:27 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-90ec147e-b89e-48fb-8dac-dc07b837a18b tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff" returned: 0 in 0.875s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-90ec147e-b89e-48fb-8dac-dc07b837a18b tempest-VolumesGetTest-921694396 None] Lock "cinder-quobyte-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff" released by "delete_volume" :: held 1.917s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:29:27 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-90ec147e-b89e-48fb-8dac-dc07b837a18b tempest-VolumesGetTest-921694396 None] Created reservations ['18315029-b3c3-4ad3-8826-996a1b9fa986', 'bfb583d3-a1b7-407c-b2b8-c403b961cd9d', 'b4358da2-d285-4096-a4b6-1048ba8360a4', 'a3874af1-a5fd-4105-b7a2-e20e7174f8e3'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:29:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-90ec147e-b89e-48fb-8dac-dc07b837a18b tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-90ec147e-b89e-48fb-8dac-dc07b837a18b tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:27 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-90ec147e-b89e-48fb-8dac-dc07b837a18b tempest-VolumesGetTest-921694396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:29:27 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-90ec147e-b89e-48fb-8dac-dc07b837a18b tempest-VolumesGetTest-921694396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:29:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-90ec147e-b89e-48fb-8dac-dc07b837a18b tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-90ec147e-b89e-48fb-8dac-dc07b837a18b tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:27 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:29:27 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f1040fe9-3074-4137-9e23-fedd83efd966 tempest-VolumesGetTest-921694396 None] Acquiring lock "cinder-ae3234a7-77c1-4d07-9b92-7aab61b33ac2-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:29:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f1040fe9-3074-4137-9e23-fedd83efd966 tempest-VolumesGetTest-921694396 None] Lock "cinder-ae3234a7-77c1-4d07-9b92-7aab61b33ac2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:29:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f1040fe9-3074-4137-9e23-fedd83efd966 tempest-VolumesGetTest-921694396 None] Acquiring lock "cinder-quobyte-ae3234a7-77c1-4d07-9b92-7aab61b33ac2" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:29:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f1040fe9-3074-4137-9e23-fedd83efd966 tempest-VolumesGetTest-921694396 None] Lock "cinder-quobyte-ae3234a7-77c1-4d07-9b92-7aab61b33ac2" acquired by "delete_volume" :: waited 0.030s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:29:28 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0c75f2-e8c4-4662-9152-3ec10768563e]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:29:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f1040fe9-3074-4137-9e23-fedd83efd966 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ae3234a7-77c1-4d07-9b92-7aab61b33ac2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:28 devstack sudo[106551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ae3234a7-77c1-4d07-9b92-7aab61b33ac2 Apr 29 17:29:28 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:28 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-90ec147e-b89e-48fb-8dac-dc07b837a18b tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.057s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:28 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-90ec147e-b89e-48fb-8dac-dc07b837a18b tempest-VolumesGetTest-921694396 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:29:28 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-90ec147e-b89e-48fb-8dac-dc07b837a18b tempest-VolumesGetTest-921694396 None] Deleted volume successfully. Apr 29 17:29:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-90ec147e-b89e-48fb-8dac-dc07b837a18b tempest-VolumesGetTest-921694396 None] Lock "cinder-3bc3e9e1-ff33-40f5-8d36-b94b550ba2ff-delete_volume" released by "delete_volume" :: held 3.364s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:29:29 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f1040fe9-3074-4137-9e23-fedd83efd966 tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ae3234a7-77c1-4d07-9b92-7aab61b33ac2" returned: 0 in 1.359s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f1040fe9-3074-4137-9e23-fedd83efd966 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ae3234a7-77c1-4d07-9b92-7aab61b33ac2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:29 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ae3234a7-77c1-4d07-9b92-7aab61b33ac2 Apr 29 17:29:29 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:30 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f1040fe9-3074-4137-9e23-fedd83efd966 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ae3234a7-77c1-4d07-9b92-7aab61b33ac2" returned: 0 in 0.630s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f1040fe9-3074-4137-9e23-fedd83efd966 tempest-VolumesGetTest-921694396 None] Lock "cinder-quobyte-ae3234a7-77c1-4d07-9b92-7aab61b33ac2" released by "delete_volume" :: held 2.052s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:29:30 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-f1040fe9-3074-4137-9e23-fedd83efd966 tempest-VolumesGetTest-921694396 None] Created reservations ['3dfa5d1a-a20a-4f66-b638-0228835317b5', '4b5d8de3-68f8-4054-8a13-3c4186acb8f5', 'd9697991-1955-4276-968f-4066b5e78cdd', 'a5b0d09c-2ea5-4f45-ade6-bb9e99d4cc73'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:29:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f1040fe9-3074-4137-9e23-fedd83efd966 tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f1040fe9-3074-4137-9e23-fedd83efd966 tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f1040fe9-3074-4137-9e23-fedd83efd966 tempest-VolumesGetTest-921694396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:29:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f1040fe9-3074-4137-9e23-fedd83efd966 tempest-VolumesGetTest-921694396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:29:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f1040fe9-3074-4137-9e23-fedd83efd966 tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f1040fe9-3074-4137-9e23-fedd83efd966 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:30 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:29:30 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:31 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Flow 'volume_create_manager' (65882701-bda4-4435-a97b-38bf9f36a81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c64ccbe-b124-45b2-a629-397d04b671da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c64ccbe-b124-45b2-a629-397d04b671da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1087020355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=494e8a60-073f-48a2-8604-f3bebf3c4d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72e26bd250d4c3e80de6b19eb5b1cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:29:32Z,use_quota=True,user_id='16bd494f87104e7782a1d624bc7bd32a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e679b8d9-9284-4ddf-b3ab-ad7337b05ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e679b8d9-9284-4ddf-b3ab-ad7337b05ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dcda222-fd06-4a9b-952a-d40f555b92b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dcda222-fd06-4a9b-952a-d40f555b92b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '494e8a60-073f-48a2-8604-f3bebf3c4d26', 'volume_name': 'volume-494e8a60-073f-48a2-8604-f3bebf3c4d26', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeeaea9c-b4a3-408f-8e0d-d633b7b6b0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeeaea9c-b4a3-408f-8e0d-d633b7b6b0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecbe8f70-198a-46af-be23-d9b6d3f6a1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:32 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Volume 494e8a60-073f-48a2-8604-f3bebf3c4d26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-494e8a60-073f-48a2-8604-f3bebf3c4d26', 'volume_size': 1} Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1087020355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=494e8a60-073f-48a2-8604-f3bebf3c4d26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72e26bd250d4c3e80de6b19eb5b1cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:29:32Z,use_quota=True,user_id='16bd494f87104e7782a1d624bc7bd32a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Creating volume 494e8a60-073f-48a2-8604-f3bebf3c4d26 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:29:32 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:29:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:32 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 1073741824 Apr 29 17:29:32 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:33 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f1040fe9-3074-4137-9e23-fedd83efd966 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 2.549s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:33 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-f1040fe9-3074-4137-9e23-fedd83efd966 tempest-VolumesGetTest-921694396 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:29:33 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f1040fe9-3074-4137-9e23-fedd83efd966 tempest-VolumesGetTest-921694396 None] Deleted volume successfully. Apr 29 17:29:33 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f1040fe9-3074-4137-9e23-fedd83efd966 tempest-VolumesGetTest-921694396 None] Lock "cinder-ae3234a7-77c1-4d07-9b92-7aab61b33ac2-delete_volume" released by "delete_volume" :: held 5.119s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:29:34 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 1073741824" returned: 0 in 1.914s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:34 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=31,cinder:INSERT=12,cinder:UPDATE=49,cinder:DELETE=4 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:29:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:34 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 Apr 29 17:29:34 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:35 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26" returned: 0 in 0.883s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:35 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] <== create_volume: return (2939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:29:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.948s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:35 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecbe8f70-198a-46af-be23-d9b6d3f6a1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-494e8a60-073f-48a2-8604-f3bebf3c4d26', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:35 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915f8b99-e777-4433-833e-ec9fcd8746b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:35 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Volume volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 (494e8a60-073f-48a2-8604-f3bebf3c4d26): created successfully Apr 29 17:29:35 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915f8b99-e777-4433-833e-ec9fcd8746b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:35 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Flow 'volume_create_manager' (65882701-bda4-4435-a97b-38bf9f36a81a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:29:35 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-1f395b47-6da3-47a1-b7a4-1f2457927623 tempest-VolumesGetTest-921694396 None] Created volume successfully. Apr 29 17:29:36 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:29:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Flow 'volume_create_manager' (2563c136-f1ed-433f-a035-2b2f15a2e55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:29:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258acca3-1f48-4a58-b272-26fbcbca6627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (258acca3-1f48-4a58-b272-26fbcbca6627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1813932910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14926966-9f3c-4b98-9626-e14e74fc9af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133ace5271ba4db4a5afb157d6a216b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:29:37Z,use_quota=True,user_id='caf74f4def714360af87873cff3d0bbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb24e69d-5ee5-4965-8e92-696198bbe264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb24e69d-5ee5-4965-8e92-696198bbe264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5ba672-e92f-46bf-9165-ff60e9846da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e5ba672-e92f-46bf-9165-ff60e9846da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14926966-9f3c-4b98-9626-e14e74fc9af2', 'volume_name': 'volume-14926966-9f3c-4b98-9626-e14e74fc9af2', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6c2f61-c274-4532-b70f-d51823647c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f6c2f61-c274-4532-b70f-d51823647c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e801f399-4f38-4b8e-8fa7-bde6dbc3b22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:37 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Volume 14926966-9f3c-4b98-9626-e14e74fc9af2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14926966-9f3c-4b98-9626-e14e74fc9af2', 'volume_size': 1} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1813932910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14926966-9f3c-4b98-9626-e14e74fc9af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133ace5271ba4db4a5afb157d6a216b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:29:37Z,use_quota=True,user_id='caf74f4def714360af87873cff3d0bbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Creating volume 14926966-9f3c-4b98-9626-e14e74fc9af2 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:29:37 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14926966-9f3c-4b98-9626-e14e74fc9af2 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:37 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14926966-9f3c-4b98-9626-e14e74fc9af2 1073741824 Apr 29 17:29:37 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Flow 'volume_create_manager' (8f90f488-b71a-4f69-a64d-490d1e8f0db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab55750-4512-4869-90d7-55720249fa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab55750-4512-4869-90d7-55720249fa1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1675611828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9332ab93-838d-455a-8b89-b953b1632005,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e72e26bd250d4c3e80de6b19eb5b1cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=494e8a60-073f-48a2-8604-f3bebf3c4d26,status='creating',terminated_at=None,updated_at=2026-04-29T15:29:37Z,use_quota=True,user_id='16bd494f87104e7782a1d624bc7bd32a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f50d920-20e7-4591-b96d-89c09dc8d3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f50d920-20e7-4591-b96d-89c09dc8d3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b660c229-578d-4eeb-91e7-9b0252d785fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b660c229-578d-4eeb-91e7-9b0252d785fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9332ab93-838d-455a-8b89-b953b1632005', 'volume_name': 'volume-9332ab93-838d-455a-8b89-b953b1632005', 'volume_size': 1, 'source_volid': '494e8a60-073f-48a2-8604-f3bebf3c4d26', 'source_volstatus': 'available'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce29bfc6-bd98-4b4a-bb62-6b57f8d630e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce29bfc6-bd98-4b4a-bb62-6b57f8d630e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad20d75-5297-4b37-a44e-c6ce0038036f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:37 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Volume 9332ab93-838d-455a-8b89-b953b1632005: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9332ab93-838d-455a-8b89-b953b1632005', 'volume_size': 1, 'source_volid': '494e8a60-073f-48a2-8604-f3bebf3c4d26', 'source_volstatus': 'available'} Apr 29 17:29:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:38 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14926966-9f3c-4b98-9626-e14e74fc9af2 1073741824" returned: 0 in 1.211s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14926966-9f3c-4b98-9626-e14e74fc9af2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:38 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14926966-9f3c-4b98-9626-e14e74fc9af2 Apr 29 17:29:38 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:39 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14926966-9f3c-4b98-9626-e14e74fc9af2" returned: 0 in 0.732s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:29:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.762s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:39 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Cloning volume 494e8a60-073f-48a2-8604-f3bebf3c4d26 to volume 9332ab93-838d-455a-8b89-b953b1632005 Apr 29 17:29:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e801f399-4f38-4b8e-8fa7-bde6dbc3b22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14926966-9f3c-4b98-9626-e14e74fc9af2', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af67d8d9-fb18-4308-952e-4a27fcc6c40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Creating offline snapshot 624fab68-13cc-44f2-bfa5-7bf7dad6e5d0 of volume 494e8a60-073f-48a2-8604-f3bebf3c4d26 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:29:39 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Volume volume-14926966-9f3c-4b98-9626-e14e74fc9af2 (14926966-9f3c-4b98-9626-e14e74fc9af2): created successfully Apr 29 17:29:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af67d8d9-fb18-4308-952e-4a27fcc6c40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Flow 'volume_create_manager' (2563c136-f1ed-433f-a035-2b2f15a2e55e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:29:39 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3b4e51-f7f2-41c8-80b5-6bff53fc8894]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:29:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:39 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-0b9af595-f67b-401e-ad97-263456cf0aa0 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Created volume successfully. Apr 29 17:29:39 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 Apr 29 17:29:39 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:40 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26" returned: 0 in 0.796s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:40 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0 1G Apr 29 17:29:40 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:40 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0 1G" returned: 0 in 0.799s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:40 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0 Apr 29 17:29:40 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:41 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0" returned: 0 in 0.661s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:41 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0 is being set with open permissions: ugo+rw Apr 29 17:29:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:41 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0 Apr 29 17:29:41 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:42 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0" returned: 0 in 0.573s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:42 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.info Apr 29 17:29:42 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:42 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.info" returned: 0 in 0.634s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:42 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.info is being set with open permissions: ugo+rw Apr 29 17:29:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:42 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.info Apr 29 17:29:42 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-3262c93f-f57e-4ed7-9b9c-03571d25cfe3 req-487b4595-e1fc-4c96-9a8e-eaa33e88591c tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:43 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.info" returned: 0 in 0.581s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:43 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Acquiring lock "cinder-quobyte-9332ab93-838d-455a-8b89-b953b1632005" by "_copy_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:29:43 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Lock "cinder-quobyte-9332ab93-838d-455a-8b89-b953b1632005" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:29:43 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] snapshot: 624fab68-13cc-44f2-bfa5-7bf7dad6e5d0, volume: 9332ab93-838d-455a-8b89-b953b1632005, {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 17:29:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:43 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:29:43 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:29:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:43 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6009f1b-1d1b-40a0-8f88-b3ed5d3cb22a]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:29:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:43 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0 Apr 29 17:29:43 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:44 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0" returned: 0 in 0.741s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-494e8a60-073f-48a2-8604-f3bebf3c4d26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:29:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 17:29:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Creating direct copy from snapshot {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 17:29:44 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[8222b2c4-bb78-4e5c-aedb-737a3396f6b0]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:29:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:44 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 Apr 29 17:29:44 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:44 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26" returned: 0 in 0.751s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:44 devstack cinder-volume[84547]: DEBUG cinder.utils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Path /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9332ab93-838d-455a-8b89-b953b1632005 not found in is_blk_device check {{(pid=84547) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 17:29:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9332ab93-838d-455a-8b89-b953b1632005 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:44 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9332ab93-838d-455a-8b89-b953b1632005 Apr 29 17:29:44 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:50 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9332ab93-838d-455a-8b89-b953b1632005" returned: 0 in 5.632s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:50 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2326d54-7067-41e4-b2e9-24651c87315b]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:29:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:50 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 Apr 29 17:29:50 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:51 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26" returned: 0 in 0.909s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:51 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9332ab93-838d-455a-8b89-b953b1632005 {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:29:51 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Converted 1024.00 MB image at 181.79 MB/s Apr 29 17:29:51 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9332ab93-838d-455a-8b89-b953b1632005 is being set with open permissions: ugo+rw Apr 29 17:29:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9332ab93-838d-455a-8b89-b953b1632005 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:51 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9332ab93-838d-455a-8b89-b953b1632005 Apr 29 17:29:51 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:52 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9332ab93-838d-455a-8b89-b953b1632005" returned: 0 in 0.568s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Lock "cinder-quobyte-9332ab93-838d-455a-8b89-b953b1632005" released by "_copy_volume_from_snapshot" :: held 8.678s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:29:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Acquiring lock "cinder-quobyte-624fab68-13cc-44f2-bfa5-7bf7dad6e5d0" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:29:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Lock "cinder-quobyte-624fab68-13cc-44f2-bfa5-7bf7dad6e5d0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:29:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Deleting offline snapshot 624fab68-13cc-44f2-bfa5-7bf7dad6e5d0 of volume 494e8a60-073f-48a2-8604-f3bebf3c4d26 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:29:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] snapshot_file for this snap is: volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:29:52 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[1249a913-90e2-4f94-ac13-2fb2a41d662b]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:29:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:52 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0 Apr 29 17:29:52 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:52 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0" returned: 0 in 0.744s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-494e8a60-073f-48a2-8604-f3bebf3c4d26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:29:52 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edf7c40-fb3c-4fd6-929f-b2c9d2a1320e]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:29:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:53 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 Apr 29 17:29:53 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:53 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=5,cinder:SELECT=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:29:53 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26" returned: 0 in 0.737s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:53 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0 Apr 29 17:29:53 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:54 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0" returned: 0 in 0.715s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:54 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0 Apr 29 17:29:54 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:54 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26.624fab68-13cc-44f2-bfa5-7bf7dad6e5d0" returned: 0 in 0.620s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Lock "cinder-quobyte-624fab68-13cc-44f2-bfa5-7bf7dad6e5d0" released by "_delete_snapshot" :: held 2.909s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:29:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.910s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-3262c93f-f57e-4ed7-9b9c-03571d25cfe3 req-487b4595-e1fc-4c96-9a8e-eaa33e88591c tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.968s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad20d75-5297-4b37-a44e-c6ce0038036f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9332ab93-838d-455a-8b89-b953b1632005', 'volume_size': 1, 'source_volid': '494e8a60-073f-48a2-8604-f3bebf3c4d26', 'source_volstatus': 'available'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d1a1da-b639-449a-908c-b33554cab7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:55 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2c0723-cfa7-48f2-abec-a6fe5aa90418]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:29:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-3262c93f-f57e-4ed7-9b9c-03571d25cfe3 req-487b4595-e1fc-4c96-9a8e-eaa33e88591c tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14926966-9f3c-4b98-9626-e14e74fc9af2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:55 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Volume volume-9332ab93-838d-455a-8b89-b953b1632005 (9332ab93-838d-455a-8b89-b953b1632005): created successfully Apr 29 17:29:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d1a1da-b639-449a-908c-b33554cab7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Flow 'volume_create_manager' (8f90f488-b71a-4f69-a64d-490d1e8f0db9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:29:55 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f6b0e5c8-d9f5-4d70-ab40-2df1bdf48ad4 tempest-VolumesGetTest-921694396 None] Created volume successfully. Apr 29 17:29:55 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14926966-9f3c-4b98-9626-e14e74fc9af2 Apr 29 17:29:55 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:55 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-3262c93f-f57e-4ed7-9b9c-03571d25cfe3 req-487b4595-e1fc-4c96-9a8e-eaa33e88591c tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14926966-9f3c-4b98-9626-e14e74fc9af2" returned: 0 in 0.695s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-3262c93f-f57e-4ed7-9b9c-03571d25cfe3 req-487b4595-e1fc-4c96-9a8e-eaa33e88591c tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.730s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-3262c93f-f57e-4ed7-9b9c-03571d25cfe3 req-487b4595-e1fc-4c96-9a8e-eaa33e88591c tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-14926966-9f3c-4b98-9626-e14e74fc9af2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aec8b5b2-7a3f-44f3-b1bc-847a8c947c24', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:29:55 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-3262c93f-f57e-4ed7-9b9c-03571d25cfe3 req-487b4595-e1fc-4c96-9a8e-eaa33e88591c tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] attachment_update completed successfully. Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Flow 'volume_create_manager' (6b7ceced-642a-450e-ae3c-cc705af9a770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (837b2326-3ea4-4957-b728-4e7e6bbd2097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (837b2326-3ea4-4957-b728-4e7e6bbd2097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:29:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1315778521',display_name='tempest-VolumesGetTest-Volume-533291466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4fff74-df58-49fb-8825-4f3d234c2e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72e26bd250d4c3e80de6b19eb5b1cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:29:57Z,use_quota=True,user_id='16bd494f87104e7782a1d624bc7bd32a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b790d4-ac45-4127-8457-e18a938cde9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b790d4-ac45-4127-8457-e18a938cde9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75425546-a40f-4d39-99ee-478f26ea4c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75425546-a40f-4d39-99ee-478f26ea4c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b4fff74-df58-49fb-8825-4f3d234c2e18', 'volume_name': 'volume-4b4fff74-df58-49fb-8825-4f3d234c2e18', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d99968a-6b99-4d1d-835a-9a84fbe3dba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d99968a-6b99-4d1d-835a-9a84fbe3dba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85118ff2-d936-4aca-a285-efb99116a597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:56 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Volume 4b4fff74-df58-49fb-8825-4f3d234c2e18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b4fff74-df58-49fb-8825-4f3d234c2e18', 'volume_size': 1} Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:29:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1315778521',display_name='tempest-VolumesGetTest-Volume-533291466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4fff74-df58-49fb-8825-4f3d234c2e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72e26bd250d4c3e80de6b19eb5b1cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:29:57Z,use_quota=True,user_id='16bd494f87104e7782a1d624bc7bd32a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Creating volume 4b4fff74-df58-49fb-8825-4f3d234c2e18 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:29:56 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:29:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b4fff74-df58-49fb-8825-4f3d234c2e18 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:56 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b4fff74-df58-49fb-8825-4f3d234c2e18 1073741824 Apr 29 17:29:56 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:57 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:29:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Flow 'volume_create_manager' (5b5ece53-3ed0-4818-9118-03fe1ca9abd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:29:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77660b79-1927-4da0-970b-8adc908f6d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77660b79-1927-4da0-970b-8adc908f6d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1862667309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbf5438d-92c2-4ca8-97fd-d282c0353c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9058d75fb82f4f658e87a3705c475e4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:29:57Z,use_quota=True,user_id='0ae5dab6d01b4afc88524345688f8c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6213711-b65d-4f74-a4c4-098d585bec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6213711-b65d-4f74-a4c4-098d585bec64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca957e0-5864-47aa-a44c-b10e04b1b9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca957e0-5864-47aa-a44c-b10e04b1b9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbf5438d-92c2-4ca8-97fd-d282c0353c5d', 'volume_name': 'volume-bbf5438d-92c2-4ca8-97fd-d282c0353c5d', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da589fd1-8912-4b7e-937c-396d1f6e478b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da589fd1-8912-4b7e-937c-396d1f6e478b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c73091f-079a-45d2-aecc-b0e1abc3d783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:57 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Volume bbf5438d-92c2-4ca8-97fd-d282c0353c5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbf5438d-92c2-4ca8-97fd-d282c0353c5d', 'volume_size': 1} Apr 29 17:29:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-33d248a5-95f6-41f3-a2d9-3deb6581da54 req-5f783f4e-8564-4942-a288-a8c53196e796 tempest-TestStampPattern-1991106930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:57 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b4fff74-df58-49fb-8825-4f3d234c2e18 1073741824" returned: 0 in 1.014s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b4fff74-df58-49fb-8825-4f3d234c2e18 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:57 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b4fff74-df58-49fb-8825-4f3d234c2e18 Apr 29 17:29:57 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:58 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b4fff74-df58-49fb-8825-4f3d234c2e18" returned: 0 in 0.616s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.218s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1862667309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbf5438d-92c2-4ca8-97fd-d282c0353c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9058d75fb82f4f658e87a3705c475e4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:29:57Z,use_quota=True,user_id='0ae5dab6d01b4afc88524345688f8c18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Creating volume bbf5438d-92c2-4ca8-97fd-d282c0353c5d {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:29:58 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bbf5438d-92c2-4ca8-97fd-d282c0353c5d 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85118ff2-d936-4aca-a285-efb99116a597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b4fff74-df58-49fb-8825-4f3d234c2e18', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:58 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bbf5438d-92c2-4ca8-97fd-d282c0353c5d 1073741824 Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c15738-fd4e-470b-92c3-3836ec9dce31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:58 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:58 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Volume volume-4b4fff74-df58-49fb-8825-4f3d234c2e18 (4b4fff74-df58-49fb-8825-4f3d234c2e18): created successfully Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57c15738-fd4e-470b-92c3-3836ec9dce31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Flow 'volume_create_manager' (6b7ceced-642a-450e-ae3c-cc705af9a770) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:29:58 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-da01751b-640b-4f5a-aa7b-4403511f9413 tempest-VolumesGetTest-921694396 None] Created volume successfully. Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-fbe6252a-d100-45d1-a97c-c41f3bf4aef6 tempest-VolumesGetTest-921694396 None] Acquiring lock "cinder-4b4fff74-df58-49fb-8825-4f3d234c2e18-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-fbe6252a-d100-45d1-a97c-c41f3bf4aef6 tempest-VolumesGetTest-921694396 None] Lock "cinder-4b4fff74-df58-49fb-8825-4f3d234c2e18-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-fbe6252a-d100-45d1-a97c-c41f3bf4aef6 tempest-VolumesGetTest-921694396 None] Acquiring lock "cinder-quobyte-4b4fff74-df58-49fb-8825-4f3d234c2e18" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-fbe6252a-d100-45d1-a97c-c41f3bf4aef6 tempest-VolumesGetTest-921694396 None] Lock "cinder-quobyte-4b4fff74-df58-49fb-8825-4f3d234c2e18" acquired by "delete_volume" :: waited 0.028s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9597a5-4015-4acf-bd8a-e7f7bbebb51d]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:29:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fbe6252a-d100-45d1-a97c-c41f3bf4aef6 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b4fff74-df58-49fb-8825-4f3d234c2e18 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:59 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b4fff74-df58-49fb-8825-4f3d234c2e18 Apr 29 17:29:59 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:59 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bbf5438d-92c2-4ca8-97fd-d282c0353c5d 1073741824" returned: 0 in 0.864s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bbf5438d-92c2-4ca8-97fd-d282c0353c5d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:59 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bbf5438d-92c2-4ca8-97fd-d282c0353c5d Apr 29 17:29:59 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:59 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fbe6252a-d100-45d1-a97c-c41f3bf4aef6 tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b4fff74-df58-49fb-8825-4f3d234c2e18" returned: 0 in 0.735s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fbe6252a-d100-45d1-a97c-c41f3bf4aef6 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b4fff74-df58-49fb-8825-4f3d234c2e18 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:59 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b4fff74-df58-49fb-8825-4f3d234c2e18 Apr 29 17:29:59 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:29:59 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Apr 29 17:29:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bbf5438d-92c2-4ca8-97fd-d282c0353c5d" returned: 0 in 0.612s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:29:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:29:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:29:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-33d248a5-95f6-41f3-a2d9-3deb6581da54 req-5f783f4e-8564-4942-a288-a8c53196e796 tempest-TestStampPattern-1991106930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.541s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:29:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c73091f-079a-45d2-aecc-b0e1abc3d783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbf5438d-92c2-4ca8-97fd-d282c0353c5d', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02cb3921-41d7-43cb-9c27-8eec4ce8f7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:29:59 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74a6a40-ebcb-4826-aaa8-8b6038e9f5c2]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:29:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-33d248a5-95f6-41f3-a2d9-3deb6581da54 req-5f783f4e-8564-4942-a288-a8c53196e796 tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:29:59 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Volume volume-bbf5438d-92c2-4ca8-97fd-d282c0353c5d (bbf5438d-92c2-4ca8-97fd-d282c0353c5d): created successfully Apr 29 17:29:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02cb3921-41d7-43cb-9c27-8eec4ce8f7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:29:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Flow 'volume_create_manager' (5b5ece53-3ed0-4818-9118-03fe1ca9abd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:30:00 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-95cd648b-038d-412d-b20a-85bc12b085ee tempest-AttachVolumeNegativeTest-698092894 None] Created volume successfully. Apr 29 17:30:00 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 Apr 29 17:30:00 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:00 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fbe6252a-d100-45d1-a97c-c41f3bf4aef6 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b4fff74-df58-49fb-8825-4f3d234c2e18" returned: 0 in 0.726s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-fbe6252a-d100-45d1-a97c-c41f3bf4aef6 tempest-VolumesGetTest-921694396 None] Lock "cinder-quobyte-4b4fff74-df58-49fb-8825-4f3d234c2e18" released by "delete_volume" :: held 1.502s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:00 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-fbe6252a-d100-45d1-a97c-c41f3bf4aef6 tempest-VolumesGetTest-921694396 None] Created reservations ['e2bf25a3-6b99-4d3e-8b32-8cd4bfb2f85f', '5c9fa009-b99b-405e-a970-ebcd20b2b57e', 'f3df4faa-3668-4600-a5a8-b3bc0f04c7f5', '78843fc3-b069-41e1-9be7-d51bd3efec2a'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:30:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fbe6252a-d100-45d1-a97c-c41f3bf4aef6 tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fbe6252a-d100-45d1-a97c-c41f3bf4aef6 tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fbe6252a-d100-45d1-a97c-c41f3bf4aef6 tempest-VolumesGetTest-921694396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:30:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fbe6252a-d100-45d1-a97c-c41f3bf4aef6 tempest-VolumesGetTest-921694396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:30:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fbe6252a-d100-45d1-a97c-c41f3bf4aef6 tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fbe6252a-d100-45d1-a97c-c41f3bf4aef6 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:00 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:30:00 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:00 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-33d248a5-95f6-41f3-a2d9-3deb6581da54 req-5f783f4e-8564-4942-a288-a8c53196e796 tempest-TestStampPattern-1991106930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308" returned: 0 in 0.824s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-33d248a5-95f6-41f3-a2d9-3deb6581da54 req-5f783f4e-8564-4942-a288-a8c53196e796 tempest-TestStampPattern-1991106930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.858s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-33d248a5-95f6-41f3-a2d9-3deb6581da54 req-5f783f4e-8564-4942-a288-a8c53196e796 tempest-TestStampPattern-1991106930 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-4bd3193e-fb20-4262-bb8d-686960ab3308', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '305cefbc-568d-4530-8b5d-d4988478e096', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:30:00 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-33d248a5-95f6-41f3-a2d9-3deb6581da54 req-5f783f4e-8564-4942-a288-a8c53196e796 tempest-TestStampPattern-1991106930 None] attachment_update completed successfully. Apr 29 17:30:01 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fbe6252a-d100-45d1-a97c-c41f3bf4aef6 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.655s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:01 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-fbe6252a-d100-45d1-a97c-c41f3bf4aef6 tempest-VolumesGetTest-921694396 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:30:01 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-fbe6252a-d100-45d1-a97c-c41f3bf4aef6 tempest-VolumesGetTest-921694396 None] Deleted volume successfully. Apr 29 17:30:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-fbe6252a-d100-45d1-a97c-c41f3bf4aef6 tempest-VolumesGetTest-921694396 None] Lock "cinder-4b4fff74-df58-49fb-8825-4f3d234c2e18-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4d39ba49-4c09-46fe-a1a3-4aff1ae515bf tempest-VolumesGetTest-921694396 None] Acquiring lock "cinder-9332ab93-838d-455a-8b89-b953b1632005-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4d39ba49-4c09-46fe-a1a3-4aff1ae515bf tempest-VolumesGetTest-921694396 None] Lock "cinder-9332ab93-838d-455a-8b89-b953b1632005-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4d39ba49-4c09-46fe-a1a3-4aff1ae515bf tempest-VolumesGetTest-921694396 None] Acquiring lock "cinder-quobyte-9332ab93-838d-455a-8b89-b953b1632005" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4d39ba49-4c09-46fe-a1a3-4aff1ae515bf tempest-VolumesGetTest-921694396 None] Lock "cinder-quobyte-9332ab93-838d-455a-8b89-b953b1632005" acquired by "delete_volume" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:01 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d39f34-1ab6-4793-a7ec-1c3738a12061]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d39ba49-4c09-46fe-a1a3-4aff1ae515bf tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9332ab93-838d-455a-8b89-b953b1632005 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:01 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9332ab93-838d-455a-8b89-b953b1632005 Apr 29 17:30:01 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:02 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d39ba49-4c09-46fe-a1a3-4aff1ae515bf tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9332ab93-838d-455a-8b89-b953b1632005" returned: 0 in 0.834s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d39ba49-4c09-46fe-a1a3-4aff1ae515bf tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9332ab93-838d-455a-8b89-b953b1632005 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:02 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9332ab93-838d-455a-8b89-b953b1632005 Apr 29 17:30:02 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:03 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d39ba49-4c09-46fe-a1a3-4aff1ae515bf tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-9332ab93-838d-455a-8b89-b953b1632005" returned: 0 in 0.705s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4d39ba49-4c09-46fe-a1a3-4aff1ae515bf tempest-VolumesGetTest-921694396 None] Lock "cinder-quobyte-9332ab93-838d-455a-8b89-b953b1632005" released by "delete_volume" :: held 1.598s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:03 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-4d39ba49-4c09-46fe-a1a3-4aff1ae515bf tempest-VolumesGetTest-921694396 None] Created reservations ['cc9856cf-c7ae-456c-82b9-53ba1b28cf04', '9d565bb8-c634-4271-a053-8da687c5f244', '182fbe7e-6d59-4034-b2e6-828c67eda435', '105f05f1-d4a9-42c3-a943-dd48537d4907'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:30:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4d39ba49-4c09-46fe-a1a3-4aff1ae515bf tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4d39ba49-4c09-46fe-a1a3-4aff1ae515bf tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4d39ba49-4c09-46fe-a1a3-4aff1ae515bf tempest-VolumesGetTest-921694396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:30:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4d39ba49-4c09-46fe-a1a3-4aff1ae515bf tempest-VolumesGetTest-921694396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:30:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4d39ba49-4c09-46fe-a1a3-4aff1ae515bf tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d39ba49-4c09-46fe-a1a3-4aff1ae515bf tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:03 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:30:03 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:03 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-6f39faf2-0d16-4b13-b499-45fd182b3707 req-6ba1e280-4206-46d7-a261-2b81dfac3c0c tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Terminate volume connection completed successfully. Apr 29 17:30:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-6f39faf2-0d16-4b13-b499-45fd182b3707 req-6ba1e280-4206-46d7-a261-2b81dfac3c0c tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Deleting attachment aec8b5b2-7a3f-44f3-b1bc-847a8c947c24. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:30:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-ded4d011-bee1-4698-99c5-32d469375064 req-acafac80-2afa-4a42-af2e-e28ac00efce4 tempest-AttachVolumeNegativeTest-698092894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-ded4d011-bee1-4698-99c5-32d469375064 req-acafac80-2afa-4a42-af2e-e28ac00efce4 tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:03 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a997256-3352-4a7a-a21b-e769b6192e92]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-ded4d011-bee1-4698-99c5-32d469375064 req-acafac80-2afa-4a42-af2e-e28ac00efce4 tempest-AttachVolumeNegativeTest-698092894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bbf5438d-92c2-4ca8-97fd-d282c0353c5d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:03 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bbf5438d-92c2-4ca8-97fd-d282c0353c5d Apr 29 17:30:03 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:03 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d39ba49-4c09-46fe-a1a3-4aff1ae515bf tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.666s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:04 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-4d39ba49-4c09-46fe-a1a3-4aff1ae515bf tempest-VolumesGetTest-921694396 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:30:04 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4d39ba49-4c09-46fe-a1a3-4aff1ae515bf tempest-VolumesGetTest-921694396 None] Deleted volume successfully. Apr 29 17:30:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4d39ba49-4c09-46fe-a1a3-4aff1ae515bf tempest-VolumesGetTest-921694396 None] Lock "cinder-9332ab93-838d-455a-8b89-b953b1632005-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2ff15fd0-10e3-487d-ba31-714978cb9547 tempest-VolumesGetTest-921694396 None] Acquiring lock "cinder-494e8a60-073f-48a2-8604-f3bebf3c4d26-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2ff15fd0-10e3-487d-ba31-714978cb9547 tempest-VolumesGetTest-921694396 None] Lock "cinder-494e8a60-073f-48a2-8604-f3bebf3c4d26-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:04 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-ded4d011-bee1-4698-99c5-32d469375064 req-acafac80-2afa-4a42-af2e-e28ac00efce4 tempest-AttachVolumeNegativeTest-698092894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bbf5438d-92c2-4ca8-97fd-d282c0353c5d" returned: 0 in 0.803s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-ded4d011-bee1-4698-99c5-32d469375064 req-acafac80-2afa-4a42-af2e-e28ac00efce4 tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.827s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2ff15fd0-10e3-487d-ba31-714978cb9547 tempest-VolumesGetTest-921694396 None] Acquiring lock "cinder-quobyte-494e8a60-073f-48a2-8604-f3bebf3c4d26" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:04 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-ded4d011-bee1-4698-99c5-32d469375064 req-acafac80-2afa-4a42-af2e-e28ac00efce4 tempest-AttachVolumeNegativeTest-698092894 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-bbf5438d-92c2-4ca8-97fd-d282c0353c5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '730bbaab-6660-4c55-8365-505d4464ca40', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:30:04 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2ff15fd0-10e3-487d-ba31-714978cb9547 tempest-VolumesGetTest-921694396 None] Lock "cinder-quobyte-494e8a60-073f-48a2-8604-f3bebf3c4d26" acquired by "delete_volume" :: waited 0.024s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:04 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[3641780e-8e43-4d2c-905d-66be36dad7e4]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2ff15fd0-10e3-487d-ba31-714978cb9547 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:04 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-ded4d011-bee1-4698-99c5-32d469375064 req-acafac80-2afa-4a42-af2e-e28ac00efce4 tempest-AttachVolumeNegativeTest-698092894 None] attachment_update completed successfully. Apr 29 17:30:04 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 Apr 29 17:30:04 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:05 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2ff15fd0-10e3-487d-ba31-714978cb9547 tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26" returned: 0 in 0.789s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2ff15fd0-10e3-487d-ba31-714978cb9547 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:05 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26 Apr 29 17:30:05 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:30:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:30:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:30:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-02ac32f4-0e10-4618-ba49-80a3aa8f95e4 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Acquiring lock "cinder-14926966-9f3c-4b98-9626-e14e74fc9af2-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:05 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:30:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-02ac32f4-0e10-4618-ba49-80a3aa8f95e4 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Lock "cinder-14926966-9f3c-4b98-9626-e14e74fc9af2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:05 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-02ac32f4-0e10-4618-ba49-80a3aa8f95e4 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Acquiring lock "cinder-quobyte-14926966-9f3c-4b98-9626-e14e74fc9af2" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-02ac32f4-0e10-4618-ba49-80a3aa8f95e4 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Lock "cinder-quobyte-14926966-9f3c-4b98-9626-e14e74fc9af2" acquired by "delete_volume" :: waited 0.026s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:05 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[1815e6b9-d449-4031-ae7c-bb57ceb97f1d]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-02ac32f4-0e10-4618-ba49-80a3aa8f95e4 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14926966-9f3c-4b98-9626-e14e74fc9af2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:05 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14926966-9f3c-4b98-9626-e14e74fc9af2 Apr 29 17:30:05 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:06 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2ff15fd0-10e3-487d-ba31-714978cb9547 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-494e8a60-073f-48a2-8604-f3bebf3c4d26" returned: 0 in 0.779s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2ff15fd0-10e3-487d-ba31-714978cb9547 tempest-VolumesGetTest-921694396 None] Lock "cinder-quobyte-494e8a60-073f-48a2-8604-f3bebf3c4d26" released by "delete_volume" :: held 1.637s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:06 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-2ff15fd0-10e3-487d-ba31-714978cb9547 tempest-VolumesGetTest-921694396 None] Created reservations ['0bc20dad-033a-4f9c-af37-6f6eb0abaf7c', '588829cc-6210-43e9-9b80-262e34bcf634', 'c70cd0ba-d5c7-4d67-980e-9941126d82c7', 'e26a45cd-78ed-40cf-a66b-1681dfc035a9'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:30:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2ff15fd0-10e3-487d-ba31-714978cb9547 tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2ff15fd0-10e3-487d-ba31-714978cb9547 tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-2ff15fd0-10e3-487d-ba31-714978cb9547 tempest-VolumesGetTest-921694396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:30:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-2ff15fd0-10e3-487d-ba31-714978cb9547 tempest-VolumesGetTest-921694396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:30:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2ff15fd0-10e3-487d-ba31-714978cb9547 tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2ff15fd0-10e3-487d-ba31-714978cb9547 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:06 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:30:06 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:06 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.834s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:30:06 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-02ac32f4-0e10-4618-ba49-80a3aa8f95e4 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14926966-9f3c-4b98-9626-e14e74fc9af2" returned: 0 in 0.935s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-02ac32f4-0e10-4618-ba49-80a3aa8f95e4 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14926966-9f3c-4b98-9626-e14e74fc9af2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:06 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14926966-9f3c-4b98-9626-e14e74fc9af2 Apr 29 17:30:06 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:06 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2ff15fd0-10e3-487d-ba31-714978cb9547 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.754s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-2ff15fd0-10e3-487d-ba31-714978cb9547 tempest-VolumesGetTest-921694396 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:30:06 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-2ff15fd0-10e3-487d-ba31-714978cb9547 tempest-VolumesGetTest-921694396 None] Deleted volume successfully. Apr 29 17:30:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2ff15fd0-10e3-487d-ba31-714978cb9547 tempest-VolumesGetTest-921694396 None] Lock "cinder-494e8a60-073f-48a2-8604-f3bebf3c4d26-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:07 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:30:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Flow 'volume_create_manager' (26284bc2-34dc-4732-8800-a9de5564c40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:30:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ebcf47-8852-411f-9315-32868bbb4cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:07 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ebcf47-8852-411f-9315-32868bbb4cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-488631899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c51c8ee-4630-45f9-b3ca-6ceec801da1d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e72e26bd250d4c3e80de6b19eb5b1cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:30:07Z,use_quota=True,user_id='16bd494f87104e7782a1d624bc7bd32a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd1d7d1-bc95-4245-acb9-632ea2935829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd1d7d1-bc95-4245-acb9-632ea2935829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a635edb-2464-41dd-98be-15a9eece32ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:07 devstack cinder-volume[84547]: DEBUG cinder.image.glance [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Creating Keystone auth plugin from conf {{(pid=84547) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 17:30:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-02ac32f4-0e10-4618-ba49-80a3aa8f95e4 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14926966-9f3c-4b98-9626-e14e74fc9af2" returned: 0 in 0.803s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:07 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-02ac32f4-0e10-4618-ba49-80a3aa8f95e4 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Lock "cinder-quobyte-14926966-9f3c-4b98-9626-e14e74fc9af2" released by "delete_volume" :: held 1.808s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:07 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-02ac32f4-0e10-4618-ba49-80a3aa8f95e4 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Created reservations ['ac03eb99-b871-420d-9cda-f0c54af13994', '9a3ba0fa-6664-4265-9735-e5d9251eb46f', '472f1fc2-07dc-448a-b969-f0ec6e9cbce4', '896aa353-140c-4115-af62-b14d0820ef3a'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:30:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-02ac32f4-0e10-4618-ba49-80a3aa8f95e4 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-02ac32f4-0e10-4618-ba49-80a3aa8f95e4 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-02ac32f4-0e10-4618-ba49-80a3aa8f95e4 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:30:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-02ac32f4-0e10-4618-ba49-80a3aa8f95e4 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:30:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-02ac32f4-0e10-4618-ba49-80a3aa8f95e4 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-02ac32f4-0e10-4618-ba49-80a3aa8f95e4 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:07 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:30:07 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a635edb-2464-41dd-98be-15a9eece32ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5c51c8ee-4630-45f9-b3ca-6ceec801da1d', 'volume_name': 'volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d64382-93b7-463e-9ec2-8c16ac91c976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53d64382-93b7-463e-9ec2-8c16ac91c976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622539a7-1326-423b-a18f-3d34c0ed4daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:08 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Volume 5c51c8ee-4630-45f9-b3ca-6ceec801da1d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 17:30:08 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Trying to clone 5c51c8ee-4630-45f9-b3ca-6ceec801da1d from image 982d68c3-05b9-445d-85e5-5c92642a92aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]). {{(pid=84547) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 17:30:08 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_eup8nodadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 17:30:08 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Image download 20.69 MB at 20.69 MB/s Apr 29 17:30:08 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f31409-7caa-4706-88b9-2b8ec1a5c082]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_eup8nodadevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:08 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-02ac32f4-0e10-4618-ba49-80a3aa8f95e4 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.956s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:08 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-02ac32f4-0e10-4618-ba49-80a3aa8f95e4 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:30:08 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-02ac32f4-0e10-4618-ba49-80a3aa8f95e4 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Deleted volume successfully. Apr 29 17:30:08 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-02ac32f4-0e10-4618-ba49-80a3aa8f95e4 tempest-TestServerVolumeAttachScenarioOldVersion-664055499 None] Lock "cinder-14926966-9f3c-4b98-9626-e14e74fc9af2-delete_volume" released by "delete_volume" :: held 3.043s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:08 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_eup8nodadevstack@QuobyteHD Apr 29 17:30:08 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:09 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_eup8nodadevstack@QuobyteHD" returned: 0 in 0.943s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:09 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Temporary image 982d68c3-05b9-445d-85e5-5c92642a92aa is fetched for user 16bd494f87104e7782a1d624bc7bd32a. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 17:30:09 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f5531d-2300-4691-9c5d-c6f17bf2d527]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_eup8nodadevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:09 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_eup8nodadevstack@QuobyteHD Apr 29 17:30:09 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:10 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-4a34bb2d-80e9-4b6f-8a43-73583c780507 req-eaf9bf57-8657-4a13-9bdb-a6a7838888e2 tempest-TestStampPattern-1991106930 None] Terminate volume connection completed successfully. Apr 29 17:30:10 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-4a34bb2d-80e9-4b6f-8a43-73583c780507 req-eaf9bf57-8657-4a13-9bdb-a6a7838888e2 tempest-TestStampPattern-1991106930 None] Deleting attachment 305cefbc-568d-4530-8b5d-d4988478e096. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:30:10 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_eup8nodadevstack@QuobyteHD" returned: 0 in 0.885s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-488631899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c51c8ee-4630-45f9-b3ca-6ceec801da1d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e72e26bd250d4c3e80de6b19eb5b1cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:30:07Z,use_quota=True,user_id='16bd494f87104e7782a1d624bc7bd32a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:30:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Creating volume 5c51c8ee-4630-45f9-b3ca-6ceec801da1d {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:30:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:30:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:30:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:30:10 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:30:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:10 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d 1073741824 Apr 29 17:30:10 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:10 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-96f0da88-5a68-4878-8015-a3c02c8c420c req-f2f6810f-1552-4c08-ae59-73692d48b4aa tempest-AttachVolumeNegativeTest-698092894 None] Terminate volume connection completed successfully. Apr 29 17:30:10 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-96f0da88-5a68-4878-8015-a3c02c8c420c req-f2f6810f-1552-4c08-ae59-73692d48b4aa tempest-AttachVolumeNegativeTest-698092894 None] Deleting attachment 730bbaab-6660-4c55-8365-505d4464ca40. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:30:11 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d 1073741824" returned: 0 in 0.965s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:11 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d Apr 29 17:30:11 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:12 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d" returned: 0 in 0.627s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:30:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:12 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Attempting download of 982d68c3-05b9-445d-85e5-5c92642a92aa ((None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}])) to volume 5c51c8ee-4630-45f9-b3ca-6ceec801da1d. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 17:30:12 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d33a3c-d033-4bf7-afba-7c39a516cdc8]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_xiirzavx {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:12 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_xiirzavx Apr 29 17:30:12 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-af4b6a25-dfa1-4664-94f2-be798715cfdb tempest-TestStampPattern-1991106930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-af4b6a25-dfa1-4664-94f2-be798715cfdb tempest-TestStampPattern-1991106930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-af4b6a25-dfa1-4664-94f2-be798715cfdb tempest-TestStampPattern-1991106930 None] Creating offline snapshot 1fc85c24-c9bd-4dab-96b4-273a94ef23d8 of volume 4bd3193e-fb20-4262-bb8d-686960ab3308 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:30:12 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e23ea0-5cd8-4538-9e03-42cad21088b5]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af4b6a25-dfa1-4664-94f2-be798715cfdb tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:12 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 Apr 29 17:30:12 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:13 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_xiirzavx" returned: 0 in 0.757s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_xiirzavx {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:13 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_xiirzavx Apr 29 17:30:13 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:13 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af4b6a25-dfa1-4664-94f2-be798715cfdb tempest-TestStampPattern-1991106930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308" returned: 0 in 0.825s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af4b6a25-dfa1-4664-94f2-be798715cfdb tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:13 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8 1G Apr 29 17:30:13 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:13 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_xiirzavx" returned: 1 in 0.784s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_xiirzavx' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:30:13 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3a76dd-3db4-4e75-b945-7048a99afa99]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_eup8nodadevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:14 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_eup8nodadevstack@QuobyteHD Apr 29 17:30:14 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:14 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af4b6a25-dfa1-4664-94f2-be798715cfdb tempest-TestStampPattern-1991106930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8 1G" returned: 0 in 1.065s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af4b6a25-dfa1-4664-94f2-be798715cfdb tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bd3193e-fb20-4262-bb8d-686960ab3308 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:14 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bd3193e-fb20-4262-bb8d-686960ab3308 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8 Apr 29 17:30:14 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:14 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_eup8nodadevstack@QuobyteHD" returned: 0 in 1.018s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:14 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] 982d68c3-05b9-445d-85e5-5c92642a92aa was qcow2, converting to raw {{(pid=84547) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 17:30:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_eup8nodadevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:14 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_eup8nodadevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d Apr 29 17:30:14 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:15 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af4b6a25-dfa1-4664-94f2-be798715cfdb tempest-TestStampPattern-1991106930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bd3193e-fb20-4262-bb8d-686960ab3308 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8" returned: 0 in 0.750s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:15 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-af4b6a25-dfa1-4664-94f2-be798715cfdb tempest-TestStampPattern-1991106930 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8 is being set with open permissions: ugo+rw Apr 29 17:30:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af4b6a25-dfa1-4664-94f2-be798715cfdb tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:15 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8 Apr 29 17:30:15 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:15 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af4b6a25-dfa1-4664-94f2-be798715cfdb tempest-TestStampPattern-1991106930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8" returned: 0 in 0.706s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af4b6a25-dfa1-4664-94f2-be798715cfdb tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:15 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.info Apr 29 17:30:15 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:16 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af4b6a25-dfa1-4664-94f2-be798715cfdb tempest-TestStampPattern-1991106930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.info" returned: 0 in 0.698s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:16 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-af4b6a25-dfa1-4664-94f2-be798715cfdb tempest-TestStampPattern-1991106930 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.info is being set with open permissions: ugo+rw Apr 29 17:30:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af4b6a25-dfa1-4664-94f2-be798715cfdb tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:16 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.info Apr 29 17:30:16 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:17 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_eup8nodadevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d" returned: 0 in 2.210s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:17 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_eup8nodadevstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:30:17 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Converted 112.00 MB image at 50.65 MB/s Apr 29 17:30:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:17 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d 1G Apr 29 17:30:17 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:17 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-af4b6a25-dfa1-4664-94f2-be798715cfdb tempest-TestStampPattern-1991106930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.info" returned: 0 in 0.683s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-af4b6a25-dfa1-4664-94f2-be798715cfdb tempest-TestStampPattern-1991106930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.879s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:17 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-af4b6a25-dfa1-4664-94f2-be798715cfdb tempest-TestStampPattern-1991106930 None] Create snapshot completed successfully Apr 29 17:30:17 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d 1G" returned: 0 in 0.810s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:17 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[4915371f-2953-443d-a8b8-b27cb4a57afc]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:18 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d Apr 29 17:30:18 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:18 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d" returned: 0 in 0.898s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:18 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d Apr 29 17:30:18 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:19 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d" returned: 1 in 0.781s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:30:19 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Downloaded image 982d68c3-05b9-445d-85e5-5c92642a92aa ((None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}])) to volume 5c51c8ee-4630-45f9-b3ca-6ceec801da1d successfully. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 17:30:19 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Temporary image 982d68c3-05b9-445d-85e5-5c92642a92aa for user 16bd494f87104e7782a1d624bc7bd32a is deleted. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 17:30:19 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Marking volume 5c51c8ee-4630-45f9-b3ca-6ceec801da1d as bootable. {{(pid=84547) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 17:30:19 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Copying metadata from image 982d68c3-05b9-445d-85e5-5c92642a92aa to 5c51c8ee-4630-45f9-b3ca-6ceec801da1d. {{(pid=84547) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 17:30:19 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Creating volume glance metadata for volume 5c51c8ee-4630-45f9-b3ca-6ceec801da1d backed by image 982d68c3-05b9-445d-85e5-5c92642a92aa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84547) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 17:30:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622539a7-1326-423b-a18f-3d34c0ed4daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1dfe1b4-e329-4533-91ec-7cf437827fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:19 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Volume volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d (5c51c8ee-4630-45f9-b3ca-6ceec801da1d): created successfully Apr 29 17:30:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1dfe1b4-e329-4533-91ec-7cf437827fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Flow 'volume_create_manager' (26284bc2-34dc-4732-8800-a9de5564c40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:30:19 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d2fb0c6f-0ac8-41db-b8af-59fb011c8f9f tempest-VolumesGetTest-921694396 None] Created volume successfully. Apr 29 17:30:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-adf458c4-d8fb-4192-b180-21dd82a0946b tempest-AttachVolumeNegativeTest-698092894 None] Acquiring lock "cinder-bbf5438d-92c2-4ca8-97fd-d282c0353c5d-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-adf458c4-d8fb-4192-b180-21dd82a0946b tempest-AttachVolumeNegativeTest-698092894 None] Lock "cinder-bbf5438d-92c2-4ca8-97fd-d282c0353c5d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-adf458c4-d8fb-4192-b180-21dd82a0946b tempest-AttachVolumeNegativeTest-698092894 None] Acquiring lock "cinder-quobyte-bbf5438d-92c2-4ca8-97fd-d282c0353c5d" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-adf458c4-d8fb-4192-b180-21dd82a0946b tempest-AttachVolumeNegativeTest-698092894 None] Lock "cinder-quobyte-bbf5438d-92c2-4ca8-97fd-d282c0353c5d" acquired by "delete_volume" :: waited 0.031s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01089f5-bdc0-4d25-ad3b-aa50894510a4]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-adf458c4-d8fb-4192-b180-21dd82a0946b tempest-AttachVolumeNegativeTest-698092894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bbf5438d-92c2-4ca8-97fd-d282c0353c5d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:21 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bbf5438d-92c2-4ca8-97fd-d282c0353c5d Apr 29 17:30:21 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Flow 'volume_create_manager' (952178ac-ced0-45d2-8c8f-24e1adc7ac15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d014527-3706-4ee2-a54d-e4e2e9b22356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d014527-3706-4ee2-a54d-e4e2e9b22356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:30:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-342567504',display_name='tempest-VolumesGetTest-Volume-1745577987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9745778-a3a7-4141-abd6-86924bb93052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72e26bd250d4c3e80de6b19eb5b1cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:30:21Z,use_quota=True,user_id='16bd494f87104e7782a1d624bc7bd32a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc178c8a-9b72-439c-b877-22d5f6c8fa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc178c8a-9b72-439c-b877-22d5f6c8fa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be573cad-6b50-48c9-85c2-7611a8140c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be573cad-6b50-48c9-85c2-7611a8140c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9745778-a3a7-4141-abd6-86924bb93052', 'volume_name': 'volume-d9745778-a3a7-4141-abd6-86924bb93052', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38fadbd4-f80e-4258-82a5-25f13548509a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38fadbd4-f80e-4258-82a5-25f13548509a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b867fce-ada8-4ce2-8d7a-4b53a87eda00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:21 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Volume d9745778-a3a7-4141-abd6-86924bb93052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9745778-a3a7-4141-abd6-86924bb93052', 'volume_size': 1} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:30:21Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-342567504',display_name='tempest-VolumesGetTest-Volume-1745577987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9745778-a3a7-4141-abd6-86924bb93052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72e26bd250d4c3e80de6b19eb5b1cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:30:21Z,use_quota=True,user_id='16bd494f87104e7782a1d624bc7bd32a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Creating volume d9745778-a3a7-4141-abd6-86924bb93052 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:30:21 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d9745778-a3a7-4141-abd6-86924bb93052 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:21 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d9745778-a3a7-4141-abd6-86924bb93052 1073741824 Apr 29 17:30:21 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:21 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-adf458c4-d8fb-4192-b180-21dd82a0946b tempest-AttachVolumeNegativeTest-698092894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bbf5438d-92c2-4ca8-97fd-d282c0353c5d" returned: 0 in 0.800s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-adf458c4-d8fb-4192-b180-21dd82a0946b tempest-AttachVolumeNegativeTest-698092894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bbf5438d-92c2-4ca8-97fd-d282c0353c5d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:21 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bbf5438d-92c2-4ca8-97fd-d282c0353c5d Apr 29 17:30:21 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:22 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d9745778-a3a7-4141-abd6-86924bb93052 1073741824" returned: 0 in 1.050s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:22 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-adf458c4-d8fb-4192-b180-21dd82a0946b tempest-AttachVolumeNegativeTest-698092894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bbf5438d-92c2-4ca8-97fd-d282c0353c5d" returned: 0 in 0.828s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d9745778-a3a7-4141-abd6-86924bb93052 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-adf458c4-d8fb-4192-b180-21dd82a0946b tempest-AttachVolumeNegativeTest-698092894 None] Lock "cinder-quobyte-bbf5438d-92c2-4ca8-97fd-d282c0353c5d" released by "delete_volume" :: held 1.703s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:22 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d9745778-a3a7-4141-abd6-86924bb93052 Apr 29 17:30:22 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:22 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-adf458c4-d8fb-4192-b180-21dd82a0946b tempest-AttachVolumeNegativeTest-698092894 None] Created reservations ['0807004d-832a-4c89-b654-750b6569b9ea', 'dd41bc97-3e1d-4b21-be04-b07d1cb82ea1', 'a46860d7-6f1b-421f-90b4-507201390fc8', '34646c68-4173-4108-bb46-a493578f5e21'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:30:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-adf458c4-d8fb-4192-b180-21dd82a0946b tempest-AttachVolumeNegativeTest-698092894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-adf458c4-d8fb-4192-b180-21dd82a0946b tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-adf458c4-d8fb-4192-b180-21dd82a0946b tempest-AttachVolumeNegativeTest-698092894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:30:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-adf458c4-d8fb-4192-b180-21dd82a0946b tempest-AttachVolumeNegativeTest-698092894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:30:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-adf458c4-d8fb-4192-b180-21dd82a0946b tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-adf458c4-d8fb-4192-b180-21dd82a0946b tempest-AttachVolumeNegativeTest-698092894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:23 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:30:23 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1b9438ba-9922-4103-aadb-d9ff657375b1 tempest-AttachVolumeNegativeTest-698092894 None] Acquiring lock "cinder-ed36c06f-dd9a-437f-80ff-9afbaa9f683d-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1b9438ba-9922-4103-aadb-d9ff657375b1 tempest-AttachVolumeNegativeTest-698092894 None] Lock "cinder-ed36c06f-dd9a-437f-80ff-9afbaa9f683d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:23 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d9745778-a3a7-4141-abd6-86924bb93052" returned: 0 in 0.852s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:23 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:30:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1b9438ba-9922-4103-aadb-d9ff657375b1 tempest-AttachVolumeNegativeTest-698092894 None] Acquiring lock "cinder-quobyte-ed36c06f-dd9a-437f-80ff-9afbaa9f683d" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b867fce-ada8-4ce2-8d7a-4b53a87eda00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9745778-a3a7-4141-abd6-86924bb93052', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c55419-00a5-49aa-a733-484b19d077d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:23 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Volume volume-d9745778-a3a7-4141-abd6-86924bb93052 (d9745778-a3a7-4141-abd6-86924bb93052): created successfully Apr 29 17:30:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c55419-00a5-49aa-a733-484b19d077d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Flow 'volume_create_manager' (952178ac-ced0-45d2-8c8f-24e1adc7ac15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:30:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1b9438ba-9922-4103-aadb-d9ff657375b1 tempest-AttachVolumeNegativeTest-698092894 None] Lock "cinder-quobyte-ed36c06f-dd9a-437f-80ff-9afbaa9f683d" acquired by "delete_volume" :: waited 0.076s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:23 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[81efa351-56a1-4cd7-b731-2d40ba39cfdc]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1b9438ba-9922-4103-aadb-d9ff657375b1 tempest-AttachVolumeNegativeTest-698092894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ed36c06f-dd9a-437f-80ff-9afbaa9f683d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:23 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-db9112bd-b017-479b-8824-105ae4db2d4e tempest-VolumesGetTest-921694396 None] Created volume successfully. Apr 29 17:30:23 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-adf458c4-d8fb-4192-b180-21dd82a0946b tempest-AttachVolumeNegativeTest-698092894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.866s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:23 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-adf458c4-d8fb-4192-b180-21dd82a0946b tempest-AttachVolumeNegativeTest-698092894 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:30:23 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-adf458c4-d8fb-4192-b180-21dd82a0946b tempest-AttachVolumeNegativeTest-698092894 None] Deleted volume successfully. Apr 29 17:30:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-adf458c4-d8fb-4192-b180-21dd82a0946b tempest-AttachVolumeNegativeTest-698092894 None] Lock "cinder-bbf5438d-92c2-4ca8-97fd-d282c0353c5d-delete_volume" released by "delete_volume" :: held 2.909s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:23 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ed36c06f-dd9a-437f-80ff-9afbaa9f683d Apr 29 17:30:23 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:24 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1b9438ba-9922-4103-aadb-d9ff657375b1 tempest-AttachVolumeNegativeTest-698092894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ed36c06f-dd9a-437f-80ff-9afbaa9f683d" returned: 0 in 0.845s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1b9438ba-9922-4103-aadb-d9ff657375b1 tempest-AttachVolumeNegativeTest-698092894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ed36c06f-dd9a-437f-80ff-9afbaa9f683d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:24 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ed36c06f-dd9a-437f-80ff-9afbaa9f683d Apr 29 17:30:24 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-35c2b907-6492-44b3-b6a1-a7d9b9e76207 tempest-VolumesGetTest-921694396 None] Acquiring lock "cinder-d9745778-a3a7-4141-abd6-86924bb93052-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-35c2b907-6492-44b3-b6a1-a7d9b9e76207 tempest-VolumesGetTest-921694396 None] Lock "cinder-d9745778-a3a7-4141-abd6-86924bb93052-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-35c2b907-6492-44b3-b6a1-a7d9b9e76207 tempest-VolumesGetTest-921694396 None] Acquiring lock "cinder-quobyte-d9745778-a3a7-4141-abd6-86924bb93052" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-35c2b907-6492-44b3-b6a1-a7d9b9e76207 tempest-VolumesGetTest-921694396 None] Lock "cinder-quobyte-d9745778-a3a7-4141-abd6-86924bb93052" acquired by "delete_volume" :: waited 0.023s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:25 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acde598-36be-402d-b2d2-698dcbbeca23]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-35c2b907-6492-44b3-b6a1-a7d9b9e76207 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d9745778-a3a7-4141-abd6-86924bb93052 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:25 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d9745778-a3a7-4141-abd6-86924bb93052 Apr 29 17:30:25 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:25 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1b9438ba-9922-4103-aadb-d9ff657375b1 tempest-AttachVolumeNegativeTest-698092894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ed36c06f-dd9a-437f-80ff-9afbaa9f683d" returned: 0 in 0.890s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1b9438ba-9922-4103-aadb-d9ff657375b1 tempest-AttachVolumeNegativeTest-698092894 None] Lock "cinder-quobyte-ed36c06f-dd9a-437f-80ff-9afbaa9f683d" released by "delete_volume" :: held 1.810s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:25 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=92,cinder:INSERT=28,cinder:UPDATE=94,cinder:DELETE=6 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:30:25 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-1b9438ba-9922-4103-aadb-d9ff657375b1 tempest-AttachVolumeNegativeTest-698092894 None] Created reservations ['05d659ab-8ced-43b3-a60d-599156fc0c9c', '1447b3da-e334-4474-86ef-2311179fcb79', '140032bb-3961-4574-a088-59fe4d9bb15f', '27b0333f-b061-4e62-ad79-e478286322e2'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:30:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1b9438ba-9922-4103-aadb-d9ff657375b1 tempest-AttachVolumeNegativeTest-698092894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1b9438ba-9922-4103-aadb-d9ff657375b1 tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:25 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1b9438ba-9922-4103-aadb-d9ff657375b1 tempest-AttachVolumeNegativeTest-698092894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:30:25 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1b9438ba-9922-4103-aadb-d9ff657375b1 tempest-AttachVolumeNegativeTest-698092894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:30:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1b9438ba-9922-4103-aadb-d9ff657375b1 tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1b9438ba-9922-4103-aadb-d9ff657375b1 tempest-AttachVolumeNegativeTest-698092894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:25 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:30:25 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d44d3d34-809c-4b11-8700-2a8e62e16100 tempest-AttachVolumeNegativeTest-698092894 None] Acquiring lock "cinder-11c726da-8788-4c37-9172-d19dfd93ce91-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d44d3d34-809c-4b11-8700-2a8e62e16100 tempest-AttachVolumeNegativeTest-698092894 None] Lock "cinder-11c726da-8788-4c37-9172-d19dfd93ce91-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d44d3d34-809c-4b11-8700-2a8e62e16100 tempest-AttachVolumeNegativeTest-698092894 None] Acquiring lock "cinder-quobyte-11c726da-8788-4c37-9172-d19dfd93ce91" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d44d3d34-809c-4b11-8700-2a8e62e16100 tempest-AttachVolumeNegativeTest-698092894 None] Lock "cinder-quobyte-11c726da-8788-4c37-9172-d19dfd93ce91" acquired by "delete_volume" :: waited 0.038s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:26 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[290e998a-d2eb-4f6b-ba91-416db3553b49]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d44d3d34-809c-4b11-8700-2a8e62e16100 tempest-AttachVolumeNegativeTest-698092894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-11c726da-8788-4c37-9172-d19dfd93ce91 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:26 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-35c2b907-6492-44b3-b6a1-a7d9b9e76207 tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d9745778-a3a7-4141-abd6-86924bb93052" returned: 0 in 1.063s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-35c2b907-6492-44b3-b6a1-a7d9b9e76207 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d9745778-a3a7-4141-abd6-86924bb93052 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:26 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d9745778-a3a7-4141-abd6-86924bb93052 Apr 29 17:30:26 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:26 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-11c726da-8788-4c37-9172-d19dfd93ce91 Apr 29 17:30:26 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:26 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1b9438ba-9922-4103-aadb-d9ff657375b1 tempest-AttachVolumeNegativeTest-698092894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.231s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:26 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-1b9438ba-9922-4103-aadb-d9ff657375b1 tempest-AttachVolumeNegativeTest-698092894 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:30:26 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-1b9438ba-9922-4103-aadb-d9ff657375b1 tempest-AttachVolumeNegativeTest-698092894 None] Deleted volume successfully. Apr 29 17:30:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1b9438ba-9922-4103-aadb-d9ff657375b1 tempest-AttachVolumeNegativeTest-698092894 None] Lock "cinder-ed36c06f-dd9a-437f-80ff-9afbaa9f683d-delete_volume" released by "delete_volume" :: held 3.430s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:27 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-35c2b907-6492-44b3-b6a1-a7d9b9e76207 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d9745778-a3a7-4141-abd6-86924bb93052" returned: 0 in 0.697s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-35c2b907-6492-44b3-b6a1-a7d9b9e76207 tempest-VolumesGetTest-921694396 None] Lock "cinder-quobyte-d9745778-a3a7-4141-abd6-86924bb93052" released by "delete_volume" :: held 1.825s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:27 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-35c2b907-6492-44b3-b6a1-a7d9b9e76207 tempest-VolumesGetTest-921694396 None] Created reservations ['4bc26500-a9c0-436c-abff-8bb99d62fb93', 'bc743cc8-062e-4a95-9092-c518cf8b9be6', 'e7118cfb-5c3a-4c6d-b0a8-19425c0af599', '70aafea2-4459-42c3-a3db-386b86d66030'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:30:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-35c2b907-6492-44b3-b6a1-a7d9b9e76207 tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-35c2b907-6492-44b3-b6a1-a7d9b9e76207 tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:27 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-35c2b907-6492-44b3-b6a1-a7d9b9e76207 tempest-VolumesGetTest-921694396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:30:27 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-35c2b907-6492-44b3-b6a1-a7d9b9e76207 tempest-VolumesGetTest-921694396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:30:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-35c2b907-6492-44b3-b6a1-a7d9b9e76207 tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-35c2b907-6492-44b3-b6a1-a7d9b9e76207 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:27 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d44d3d34-809c-4b11-8700-2a8e62e16100 tempest-AttachVolumeNegativeTest-698092894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-11c726da-8788-4c37-9172-d19dfd93ce91" returned: 0 in 0.949s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d44d3d34-809c-4b11-8700-2a8e62e16100 tempest-AttachVolumeNegativeTest-698092894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-11c726da-8788-4c37-9172-d19dfd93ce91 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:27 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:30:27 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:27 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-11c726da-8788-4c37-9172-d19dfd93ce91 Apr 29 17:30:27 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] Acquiring lock "cinder-5c51c8ee-4630-45f9-b3ca-6ceec801da1d-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] Lock "cinder-5c51c8ee-4630-45f9-b3ca-6ceec801da1d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] Acquiring lock "cinder-quobyte-5c51c8ee-4630-45f9-b3ca-6ceec801da1d" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] Lock "cinder-quobyte-5c51c8ee-4630-45f9-b3ca-6ceec801da1d" acquired by "delete_volume" :: waited 0.022s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:27 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[066966a2-14cd-4963-86c1-6a7bc96d3c3d]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:28 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d Apr 29 17:30:28 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:28 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-35c2b907-6492-44b3-b6a1-a7d9b9e76207 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.977s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:28 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-35c2b907-6492-44b3-b6a1-a7d9b9e76207 tempest-VolumesGetTest-921694396 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:30:28 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-35c2b907-6492-44b3-b6a1-a7d9b9e76207 tempest-VolumesGetTest-921694396 None] Deleted volume successfully. Apr 29 17:30:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-35c2b907-6492-44b3-b6a1-a7d9b9e76207 tempest-VolumesGetTest-921694396 None] Lock "cinder-d9745778-a3a7-4141-abd6-86924bb93052-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:28 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d44d3d34-809c-4b11-8700-2a8e62e16100 tempest-AttachVolumeNegativeTest-698092894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-11c726da-8788-4c37-9172-d19dfd93ce91" returned: 0 in 1.069s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d44d3d34-809c-4b11-8700-2a8e62e16100 tempest-AttachVolumeNegativeTest-698092894 None] Lock "cinder-quobyte-11c726da-8788-4c37-9172-d19dfd93ce91" released by "delete_volume" :: held 2.100s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:28 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-d44d3d34-809c-4b11-8700-2a8e62e16100 tempest-AttachVolumeNegativeTest-698092894 None] Created reservations ['9e372ff5-ee33-4b66-ad29-29d07e104e4e', '34e43852-59ed-4787-a6c8-cb38f4f2ba62', 'b9aea8cd-f43b-4261-864b-ae1566d32266', '8df6df78-ddc6-4076-8717-23f434d9f80a'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:30:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d44d3d34-809c-4b11-8700-2a8e62e16100 tempest-AttachVolumeNegativeTest-698092894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d44d3d34-809c-4b11-8700-2a8e62e16100 tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d44d3d34-809c-4b11-8700-2a8e62e16100 tempest-AttachVolumeNegativeTest-698092894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:30:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d44d3d34-809c-4b11-8700-2a8e62e16100 tempest-AttachVolumeNegativeTest-698092894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:30:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d44d3d34-809c-4b11-8700-2a8e62e16100 tempest-AttachVolumeNegativeTest-698092894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d44d3d34-809c-4b11-8700-2a8e62e16100 tempest-AttachVolumeNegativeTest-698092894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:28 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:30:28 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:28 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d" returned: 0 in 1.156s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:29 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d Apr 29 17:30:29 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:29 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d44d3d34-809c-4b11-8700-2a8e62e16100 tempest-AttachVolumeNegativeTest-698092894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.723s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:29 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-d44d3d34-809c-4b11-8700-2a8e62e16100 tempest-AttachVolumeNegativeTest-698092894 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:30:29 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d44d3d34-809c-4b11-8700-2a8e62e16100 tempest-AttachVolumeNegativeTest-698092894 None] Deleted volume successfully. Apr 29 17:30:29 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d44d3d34-809c-4b11-8700-2a8e62e16100 tempest-AttachVolumeNegativeTest-698092894 None] Lock "cinder-11c726da-8788-4c37-9172-d19dfd93ce91-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:29 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d" returned: 1 in 0.924s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:30:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:29 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d Apr 29 17:30:29 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Flow 'volume_create_manager' (929567aa-d14f-4fa9-8e67-77c7db5f0d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4959db68-02b0-49e8-8494-5325a35d8e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4959db68-02b0-49e8-8494-5325a35d8e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1836237508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa17f3d2-ebac-4d5a-938c-9f5a3a120798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2ab09ce7e74e18bf862c0bcb16f595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1fc85c24-c9bd-4dab-96b4-273a94ef23d8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:30:30Z,use_quota=True,user_id='75a25b81d53c42bf964508bc615a80d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea009391-8e09-4113-a6c6-a24657c241b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea009391-8e09-4113-a6c6-a24657c241b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0acf75-0a74-4d46-8b2b-7e0a55575f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f0acf75-0a74-4d46-8b2b-7e0a55575f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fa17f3d2-ebac-4d5a-938c-9f5a3a120798', 'volume_name': 'volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798', 'volume_size': 1, 'snapshot_id': '1fc85c24-c9bd-4dab-96b4-273a94ef23d8'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9db810-3854-414a-aef0-8ab5ed0040a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9db810-3854-414a-aef0-8ab5ed0040a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6b6be4-2039-46af-b1bb-4c4c67d98b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:30 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Volume fa17f3d2-ebac-4d5a-938c-9f5a3a120798: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798', 'volume_size': 1, 'snapshot_id': '1fc85c24-c9bd-4dab-96b4-273a94ef23d8'} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Acquiring lock "cinder-quobyte-1fc85c24-c9bd-4dab-96b4-273a94ef23d8-fa17f3d2-ebac-4d5a-938c-9f5a3a120798" by "_create_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Lock "cinder-quobyte-1fc85c24-c9bd-4dab-96b4-273a94ef23d8-fa17f3d2-ebac-4d5a-938c-9f5a3a120798" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Creating volume fa17f3d2-ebac-4d5a-938c-9f5a3a120798 from snapshot 1fc85c24-c9bd-4dab-96b4-273a94ef23d8 {{(pid=84547) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Acquiring lock "cinder-quobyte-fa17f3d2-ebac-4d5a-938c-9f5a3a120798" by "_copy_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Lock "cinder-quobyte-fa17f3d2-ebac-4d5a-938c-9f5a3a120798" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] snapshot: 1fc85c24-c9bd-4dab-96b4-273a94ef23d8, volume: fa17f3d2-ebac-4d5a-938c-9f5a3a120798, {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[9653799a-8d6f-4248-b846-89802c69934c]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:30 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8 Apr 29 17:30:30 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:30 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5c51c8ee-4630-45f9-b3ca-6ceec801da1d" returned: 0 in 0.982s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] Lock "cinder-quobyte-5c51c8ee-4630-45f9-b3ca-6ceec801da1d" released by "delete_volume" :: held 3.190s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:30 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] Created reservations ['ca0c97c4-4d69-49a8-bce9-2e51318508c9', '54abae57-9353-4b20-8fec-edb39a8c01ca', '3cd19b34-234a-4689-a9c4-7c93ad4e8210', 'ade143b7-590e-42e0-8cb8-ac2c2a9973bc'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:30:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:30:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:30:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:31 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:30:31 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:31 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8" returned: 0 in 0.964s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bd3193e-fb20-4262-bb8d-686960ab3308(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:30:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 17:30:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Creating direct copy from snapshot {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 17:30:31 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[6113a7de-9135-42d9-9d3f-40e2121d4e55]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:31 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 Apr 29 17:30:31 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:31 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.759s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:31 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:30:31 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] Deleted volume successfully. Apr 29 17:30:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4d36ef14-ed96-498f-96e4-5d962d310c72 tempest-VolumesGetTest-921694396 None] Lock "cinder-5c51c8ee-4630-45f9-b3ca-6ceec801da1d-delete_volume" released by "delete_volume" :: held 4.256s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:32 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308" returned: 0 in 0.986s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:32 devstack cinder-volume[84547]: DEBUG cinder.utils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Path /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798 not found in is_blk_device check {{(pid=84547) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 17:30:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:32 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798 Apr 29 17:30:32 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:39 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798" returned: 0 in 6.742s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:39 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22f7980-98f0-4fe3-9b69-68e9aa9deed1]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:39 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 Apr 29 17:30:39 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:40 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308" returned: 0 in 1.214s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:40 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308, size 1024.00 MB, duration 6.74 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798 {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:30:40 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Converted 1024.00 MB image at 151.85 MB/s Apr 29 17:30:40 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798 is being set with open permissions: ugo+rw Apr 29 17:30:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:40 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798 Apr 29 17:30:40 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:41 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=99,cinder:INSERT=25,cinder:DELETE=7,cinder:SELECT=81 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:30:41 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798" returned: 0 in 0.808s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:41 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Lock "cinder-quobyte-fa17f3d2-ebac-4d5a-938c-9f5a3a120798" released by "_copy_volume_from_snapshot" :: held 10.912s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:41 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Lock "cinder-quobyte-1fc85c24-c9bd-4dab-96b4-273a94ef23d8-fa17f3d2-ebac-4d5a-938c-9f5a3a120798" released by "_create_volume_from_snapshot" :: held 10.979s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.004s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6b6be4-2039-46af-b1bb-4c4c67d98b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798', 'volume_size': 1, 'snapshot_id': '1fc85c24-c9bd-4dab-96b4-273a94ef23d8'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdb64d1-5972-4c36-b36b-4463ee51f8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:41 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Volume volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798 (fa17f3d2-ebac-4d5a-938c-9f5a3a120798): created successfully Apr 29 17:30:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdb64d1-5972-4c36-b36b-4463ee51f8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Flow 'volume_create_manager' (929567aa-d14f-4fa9-8e67-77c7db5f0d58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:30:41 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-269f07b4-fd74-4173-af8b-d5d308337e06 tempest-TestStampPattern-1991106930 None] Created volume successfully. Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Flow 'volume_create_manager' (2967ed40-fa5c-482f-a499-9f309bb567ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a976fc-872f-4b13-8bf2-d96c313394ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a976fc-872f-4b13-8bf2-d96c313394ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1074412109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8509017f-99ef-4476-a758-cb9c78904410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30d9bb69ea348b8a113d4a2ad083a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:30:46Z,use_quota=True,user_id='cca4785d28ef4f3db124544e6f362f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5662b2c-a7bd-479c-a427-d9b5a2292d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5662b2c-a7bd-479c-a427-d9b5a2292d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28383c7c-8120-4de4-bf58-b5396dbdb9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28383c7c-8120-4de4-bf58-b5396dbdb9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8509017f-99ef-4476-a758-cb9c78904410', 'volume_name': 'volume-8509017f-99ef-4476-a758-cb9c78904410', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974f7fa1-ad68-4a06-b47e-8e715005c04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (974f7fa1-ad68-4a06-b47e-8e715005c04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f6521f-3d46-4819-a0bf-b9dd895aee91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:46 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Volume 8509017f-99ef-4476-a758-cb9c78904410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8509017f-99ef-4476-a758-cb9c78904410', 'volume_size': 1} Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1074412109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8509017f-99ef-4476-a758-cb9c78904410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30d9bb69ea348b8a113d4a2ad083a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:30:46Z,use_quota=True,user_id='cca4785d28ef4f3db124544e6f362f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Creating volume 8509017f-99ef-4476-a758-cb9c78904410 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:30:46 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:30:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:46 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410 1073741824 Apr 29 17:30:46 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:47 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410 1073741824" returned: 0 in 0.968s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:47 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410 Apr 29 17:30:47 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:48 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410" returned: 0 in 0.863s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] <== create_volume: return (1897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:30:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.900s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f6521f-3d46-4819-a0bf-b9dd895aee91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8509017f-99ef-4476-a758-cb9c78904410', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d68f0b8-6310-4e08-baa1-f03fcc51cdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:48 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Volume volume-8509017f-99ef-4476-a758-cb9c78904410 (8509017f-99ef-4476-a758-cb9c78904410): created successfully Apr 29 17:30:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d68f0b8-6310-4e08-baa1-f03fcc51cdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Flow 'volume_create_manager' (2967ed40-fa5c-482f-a499-9f309bb567ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:30:48 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-38b9622c-4e73-4599-9afc-463358e2d954 req-ee1fb2ac-e5bf-4012-8ab0-eb8e129478b4 tempest-VolumesSnapshotsTestJSON-437292743 None] Created volume successfully. Apr 29 17:30:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-3684b19a-8ede-43bc-a2b4-294c212b962b req-e9bf92e8-a75d-455c-981e-81fd664cd98f tempest-VolumesSnapshotsTestJSON-437292743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-3684b19a-8ede-43bc-a2b4-294c212b962b req-e9bf92e8-a75d-455c-981e-81fd664cd98f tempest-VolumesSnapshotsTestJSON-437292743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [req-3684b19a-8ede-43bc-a2b4-294c212b962b req-e9bf92e8-a75d-455c-981e-81fd664cd98f tempest-VolumesSnapshotsTestJSON-437292743 None] Creating offline snapshot 50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6 of volume 8509017f-99ef-4476-a758-cb9c78904410 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:30:48 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77efd5c-4735-497d-abd4-18c2f5ad3800]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-3684b19a-8ede-43bc-a2b4-294c212b962b req-e9bf92e8-a75d-455c-981e-81fd664cd98f tempest-VolumesSnapshotsTestJSON-437292743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:49 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410 Apr 29 17:30:49 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:49 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-3684b19a-8ede-43bc-a2b4-294c212b962b req-e9bf92e8-a75d-455c-981e-81fd664cd98f tempest-VolumesSnapshotsTestJSON-437292743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410" returned: 0 in 0.888s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-3684b19a-8ede-43bc-a2b4-294c212b962b req-e9bf92e8-a75d-455c-981e-81fd664cd98f tempest-VolumesSnapshotsTestJSON-437292743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:49 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6 1G Apr 29 17:30:49 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:51 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-3684b19a-8ede-43bc-a2b4-294c212b962b req-e9bf92e8-a75d-455c-981e-81fd664cd98f tempest-VolumesSnapshotsTestJSON-437292743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6 1G" returned: 0 in 1.260s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-3684b19a-8ede-43bc-a2b4-294c212b962b req-e9bf92e8-a75d-455c-981e-81fd664cd98f tempest-VolumesSnapshotsTestJSON-437292743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8509017f-99ef-4476-a758-cb9c78904410 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:51 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8509017f-99ef-4476-a758-cb9c78904410 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6 Apr 29 17:30:51 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:52 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-3684b19a-8ede-43bc-a2b4-294c212b962b req-e9bf92e8-a75d-455c-981e-81fd664cd98f tempest-VolumesSnapshotsTestJSON-437292743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8509017f-99ef-4476-a758-cb9c78904410 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6" returned: 0 in 0.926s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:52 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [req-3684b19a-8ede-43bc-a2b4-294c212b962b req-e9bf92e8-a75d-455c-981e-81fd664cd98f tempest-VolumesSnapshotsTestJSON-437292743 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6 is being set with open permissions: ugo+rw Apr 29 17:30:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-3684b19a-8ede-43bc-a2b4-294c212b962b req-e9bf92e8-a75d-455c-981e-81fd664cd98f tempest-VolumesSnapshotsTestJSON-437292743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:52 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6 Apr 29 17:30:52 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:52 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-3684b19a-8ede-43bc-a2b4-294c212b962b req-e9bf92e8-a75d-455c-981e-81fd664cd98f tempest-VolumesSnapshotsTestJSON-437292743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6" returned: 0 in 0.755s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-3684b19a-8ede-43bc-a2b4-294c212b962b req-e9bf92e8-a75d-455c-981e-81fd664cd98f tempest-VolumesSnapshotsTestJSON-437292743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:52 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.info Apr 29 17:30:52 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:53 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-3684b19a-8ede-43bc-a2b4-294c212b962b req-e9bf92e8-a75d-455c-981e-81fd664cd98f tempest-VolumesSnapshotsTestJSON-437292743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.info" returned: 0 in 0.853s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:53 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [req-3684b19a-8ede-43bc-a2b4-294c212b962b req-e9bf92e8-a75d-455c-981e-81fd664cd98f tempest-VolumesSnapshotsTestJSON-437292743 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.info is being set with open permissions: ugo+rw Apr 29 17:30:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-3684b19a-8ede-43bc-a2b4-294c212b962b req-e9bf92e8-a75d-455c-981e-81fd664cd98f tempest-VolumesSnapshotsTestJSON-437292743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:53 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.info Apr 29 17:30:53 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:54 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-3684b19a-8ede-43bc-a2b4-294c212b962b req-e9bf92e8-a75d-455c-981e-81fd664cd98f tempest-VolumesSnapshotsTestJSON-437292743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.info" returned: 0 in 0.748s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-3684b19a-8ede-43bc-a2b4-294c212b962b req-e9bf92e8-a75d-455c-981e-81fd664cd98f tempest-VolumesSnapshotsTestJSON-437292743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.600s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:54 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-3684b19a-8ede-43bc-a2b4-294c212b962b req-e9bf92e8-a75d-455c-981e-81fd664cd98f tempest-VolumesSnapshotsTestJSON-437292743 None] Create snapshot completed successfully Apr 29 17:30:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] Acquiring lock "cinder-50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] Lock "cinder-50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] Acquiring lock "cinder-quobyte-8509017f-99ef-4476-a758-cb9c78904410" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] Lock "cinder-quobyte-8509017f-99ef-4476-a758-cb9c78904410" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] Acquiring lock "cinder-quobyte-50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] Lock "cinder-quobyte-50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] Deleting offline snapshot 50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6 of volume 8509017f-99ef-4476-a758-cb9c78904410 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:30:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] snapshot_file for this snap is: volume-8509017f-99ef-4476-a758-cb9c78904410.50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:30:54 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[0536ba8c-af2c-4cc7-9d9f-5c0c896b81ef]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:55 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6 Apr 29 17:30:55 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:55 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6" returned: 0 in 0.845s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:55 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8509017f-99ef-4476-a758-cb9c78904410(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:30:55 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[a943ba4d-b5e8-4423-a06d-e157336c3c14]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:55 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410 Apr 29 17:30:55 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:56 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410" returned: 0 in 0.870s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:56 devstack sudo[107775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6 Apr 29 17:30:56 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:57 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6" returned: 0 in 0.805s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:57 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6 Apr 29 17:30:57 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:58 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Apr 29 17:30:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410.50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6" returned: 0 in 0.831s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:30:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] Lock "cinder-quobyte-50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6" released by "_delete_snapshot" :: held 3.508s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] Lock "cinder-quobyte-8509017f-99ef-4476-a758-cb9c78904410" released by "delete_snapshot" :: held 3.549s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:58 devstack cinder-volume[84547]: DEBUG cinder.quota [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] Created reservations ['37b2ff86-ad70-4bf1-87d5-4941dc0e7e9e', 'a4c2011e-84d0-4ad1-b98e-80d280783fb6', '920ca8e5-1cfe-46a5-8092-3e53a52b81ce', 'ef6e91ba-894c-4a35-a848-7bbdeadc36fe'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:30:58 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] Delete snapshot completed successfully. Apr 29 17:30:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-daab82fd-ad10-4367-b3ce-2e8783bbcd8f req-d1d17394-d7ee-4226-8c0a-f505a2d220b7 tempest-VolumesSnapshotsTestJSON-437292743 None] Lock "cinder-50aa6cc6-85c4-4dd1-ab8e-e651cb8d21e6-delete_snapshot" released by "delete_snapshot" :: held 3.732s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Flow 'volume_create_manager' (f754071a-04cd-47c8-a027-cea0acdbd8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71235f8-033e-4d68-a726-70d12888ce40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71235f8-033e-4d68-a726-70d12888ce40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-186582065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=577b2026-7de5-4ead-a86c-8e09e96c4ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77efeec60544d47bdcf52e70ae40517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:30:59Z,use_quota=True,user_id='ba9bb61d783e468dbc781aa7ca9c8213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32448db3-b04d-4050-8a87-fb6f9d844e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32448db3-b04d-4050-8a87-fb6f9d844e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483e9346-1867-460f-8616-0c1d96ca73d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483e9346-1867-460f-8616-0c1d96ca73d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '577b2026-7de5-4ead-a86c-8e09e96c4ed2', 'volume_name': 'volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55a81b0-c644-4a6e-afa5-a86e61b4f7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55a81b0-c644-4a6e-afa5-a86e61b4f7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1483997-76a5-4d91-8ebe-bfec5d429c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:30:59 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Volume 577b2026-7de5-4ead-a86c-8e09e96c4ed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2', 'volume_size': 1} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-186582065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=577b2026-7de5-4ead-a86c-8e09e96c4ed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77efeec60544d47bdcf52e70ae40517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:30:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:30:59Z,use_quota=True,user_id='ba9bb61d783e468dbc781aa7ca9c8213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Creating volume 577b2026-7de5-4ead-a86c-8e09e96c4ed2 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:30:59 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-f141f470-fc7e-49f2-bda9-e0b318accf57 req-aefdfddc-7851-420c-90e7-ceecac01c715 tempest-VolumesSnapshotsTestJSON-437292743 None] Acquiring lock "cinder-8509017f-99ef-4476-a758-cb9c78904410-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:59 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2 1073741824 Apr 29 17:30:59 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-f141f470-fc7e-49f2-bda9-e0b318accf57 req-aefdfddc-7851-420c-90e7-ceecac01c715 tempest-VolumesSnapshotsTestJSON-437292743 None] Lock "cinder-8509017f-99ef-4476-a758-cb9c78904410-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-f141f470-fc7e-49f2-bda9-e0b318accf57 req-aefdfddc-7851-420c-90e7-ceecac01c715 tempest-VolumesSnapshotsTestJSON-437292743 None] Acquiring lock "cinder-quobyte-8509017f-99ef-4476-a758-cb9c78904410" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-f141f470-fc7e-49f2-bda9-e0b318accf57 req-aefdfddc-7851-420c-90e7-ceecac01c715 tempest-VolumesSnapshotsTestJSON-437292743 None] Lock "cinder-quobyte-8509017f-99ef-4476-a758-cb9c78904410" acquired by "delete_volume" :: waited 0.036s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e4a073-b558-4945-a904-9e6987d45d36]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:30:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f141f470-fc7e-49f2-bda9-e0b318accf57 req-aefdfddc-7851-420c-90e7-ceecac01c715 tempest-VolumesSnapshotsTestJSON-437292743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:30:59 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410 Apr 29 17:30:59 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:00 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f141f470-fc7e-49f2-bda9-e0b318accf57 req-aefdfddc-7851-420c-90e7-ceecac01c715 tempest-VolumesSnapshotsTestJSON-437292743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410" returned: 0 in 0.858s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f141f470-fc7e-49f2-bda9-e0b318accf57 req-aefdfddc-7851-420c-90e7-ceecac01c715 tempest-VolumesSnapshotsTestJSON-437292743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:00 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410 Apr 29 17:31:00 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:00 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2 1073741824" returned: 0 in 1.160s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:00 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2 Apr 29 17:31:00 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:01 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:01 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f141f470-fc7e-49f2-bda9-e0b318accf57 req-aefdfddc-7851-420c-90e7-ceecac01c715 tempest-VolumesSnapshotsTestJSON-437292743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-8509017f-99ef-4476-a758-cb9c78904410" returned: 0 in 0.795s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2" returned: 0 in 0.710s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.942s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-f141f470-fc7e-49f2-bda9-e0b318accf57 req-aefdfddc-7851-420c-90e7-ceecac01c715 tempest-VolumesSnapshotsTestJSON-437292743 None] Lock "cinder-quobyte-8509017f-99ef-4476-a758-cb9c78904410" released by "delete_volume" :: held 1.773s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1483997-76a5-4d91-8ebe-bfec5d429c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d71f6a3-df6b-416b-b155-2df2dbbcb752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Flow 'volume_create_manager' (5fd5532e-3427-4548-b92c-0235797f81f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c89f34-b9ce-44a4-b2ec-4a680d29692a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c89f34-b9ce-44a4-b2ec-4a680d29692a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-428454510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c768ff76-fbc6-4b91-9dde-f84ef8d154f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dfbd524238049ad928c07768065894b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:31:01Z,use_quota=True,user_id='5bd53c3270744d599cc95e1cf261a5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8356b063-f1fa-4b8f-b3c8-0fa65880c12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8356b063-f1fa-4b8f-b3c8-0fa65880c12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dc7ce65-4b34-4dab-b7d2-47f30b6e3ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dc7ce65-4b34-4dab-b7d2-47f30b6e3ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c768ff76-fbc6-4b91-9dde-f84ef8d154f4', 'volume_name': 'volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a250235-2628-48eb-9ef2-a04c3573d342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a250235-2628-48eb-9ef2-a04c3573d342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c2f0d7-34ea-427e-844e-0492a0478b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:01 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Volume c768ff76-fbc6-4b91-9dde-f84ef8d154f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4', 'volume_size': 1} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-428454510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c768ff76-fbc6-4b91-9dde-f84ef8d154f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dfbd524238049ad928c07768065894b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:31:01Z,use_quota=True,user_id='5bd53c3270744d599cc95e1cf261a5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Creating volume c768ff76-fbc6-4b91-9dde-f84ef8d154f4 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:31:01 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:01 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Volume volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2 (577b2026-7de5-4ead-a86c-8e09e96c4ed2): created successfully Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d71f6a3-df6b-416b-b155-2df2dbbcb752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Flow 'volume_create_manager' (f754071a-04cd-47c8-a027-cea0acdbd8bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:31:01 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 1073741824 Apr 29 17:31:01 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:01 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-c3966af9-0476-4d4f-bf26-9918cdfdd0d0 tempest-VolumesSnapshotTestJSON-532061065 None] Created volume successfully. Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.quota [req-f141f470-fc7e-49f2-bda9-e0b318accf57 req-aefdfddc-7851-420c-90e7-ceecac01c715 tempest-VolumesSnapshotsTestJSON-437292743 None] Created reservations ['602dee0a-cbdc-4d13-8d4d-3226d9543d70', '409cdca6-aa80-4aad-8ebe-3eeafa62ecfa', 'a80a8d09-aca7-4b0c-8f7e-24b8eaa50258', '763d99a7-5859-45f0-9890-29b494192171'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f141f470-fc7e-49f2-bda9-e0b318accf57 req-aefdfddc-7851-420c-90e7-ceecac01c715 tempest-VolumesSnapshotsTestJSON-437292743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f141f470-fc7e-49f2-bda9-e0b318accf57 req-aefdfddc-7851-420c-90e7-ceecac01c715 tempest-VolumesSnapshotsTestJSON-437292743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-f141f470-fc7e-49f2-bda9-e0b318accf57 req-aefdfddc-7851-420c-90e7-ceecac01c715 tempest-VolumesSnapshotsTestJSON-437292743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-f141f470-fc7e-49f2-bda9-e0b318accf57 req-aefdfddc-7851-420c-90e7-ceecac01c715 tempest-VolumesSnapshotsTestJSON-437292743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f141f470-fc7e-49f2-bda9-e0b318accf57 req-aefdfddc-7851-420c-90e7-ceecac01c715 tempest-VolumesSnapshotsTestJSON-437292743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f141f470-fc7e-49f2-bda9-e0b318accf57 req-aefdfddc-7851-420c-90e7-ceecac01c715 tempest-VolumesSnapshotsTestJSON-437292743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:01 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:31:01 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:02 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f141f470-fc7e-49f2-bda9-e0b318accf57 req-aefdfddc-7851-420c-90e7-ceecac01c715 tempest-VolumesSnapshotsTestJSON-437292743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.778s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:02 devstack cinder-volume[84547]: DEBUG cinder.manager [req-f141f470-fc7e-49f2-bda9-e0b318accf57 req-aefdfddc-7851-420c-90e7-ceecac01c715 tempest-VolumesSnapshotsTestJSON-437292743 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:31:02 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-f141f470-fc7e-49f2-bda9-e0b318accf57 req-aefdfddc-7851-420c-90e7-ceecac01c715 tempest-VolumesSnapshotsTestJSON-437292743 None] Deleted volume successfully. Apr 29 17:31:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-f141f470-fc7e-49f2-bda9-e0b318accf57 req-aefdfddc-7851-420c-90e7-ceecac01c715 tempest-VolumesSnapshotsTestJSON-437292743 None] Lock "cinder-8509017f-99ef-4476-a758-cb9c78904410-delete_volume" released by "delete_volume" :: held 3.001s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:02 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 1073741824" returned: 0 in 1.062s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:02 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 Apr 29 17:31:02 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2ae31933-35c6-4e55-8f16-7757ddb49d46 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:03 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4" returned: 0 in 0.861s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:31:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.988s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2ae31933-35c6-4e55-8f16-7757ddb49d46 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.551s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c2f0d7-34ea-427e-844e-0492a0478b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ffce39-0f9d-43bd-bc41-44c8cc1e48d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-2ae31933-35c6-4e55-8f16-7757ddb49d46 tempest-VolumesSnapshotTestJSON-532061065 None] Creating offline snapshot 85e65111-cf77-4db0-b96c-bf903aded27f of volume 577b2026-7de5-4ead-a86c-8e09e96c4ed2 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:31:03 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Volume volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 (c768ff76-fbc6-4b91-9dde-f84ef8d154f4): created successfully Apr 29 17:31:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90ffce39-0f9d-43bd-bc41-44c8cc1e48d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Flow 'volume_create_manager' (5fd5532e-3427-4548-b92c-0235797f81f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:31:03 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[33200b96-4afa-4dcb-8921-841f7fb9f8aa]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2ae31933-35c6-4e55-8f16-7757ddb49d46 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:03 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-894ad57c-12e3-4bd3-8e53-8bdf772fac6f tempest-SnapshotDependencyTests-1720259262 None] Created volume successfully. Apr 29 17:31:03 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2 Apr 29 17:31:03 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:04 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2ae31933-35c6-4e55-8f16-7757ddb49d46 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2" returned: 0 in 0.914s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2ae31933-35c6-4e55-8f16-7757ddb49d46 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.85e65111-cf77-4db0-b96c-bf903aded27f 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:04 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.85e65111-cf77-4db0-b96c-bf903aded27f 1G Apr 29 17:31:04 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f32bbe04-fa60-434f-b3a0-2179223b6dbf tempest-SnapshotDependencyTests-1720259262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:31:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:31:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:31:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:05 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:31:05 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:05 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2ae31933-35c6-4e55-8f16-7757ddb49d46 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.85e65111-cf77-4db0-b96c-bf903aded27f 1G" returned: 0 in 1.520s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2ae31933-35c6-4e55-8f16-7757ddb49d46 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.85e65111-cf77-4db0-b96c-bf903aded27f {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:05 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.85e65111-cf77-4db0-b96c-bf903aded27f Apr 29 17:31:05 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:06 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.070s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:31:07 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2ae31933-35c6-4e55-8f16-7757ddb49d46 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.85e65111-cf77-4db0-b96c-bf903aded27f" returned: 0 in 1.150s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:07 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-2ae31933-35c6-4e55-8f16-7757ddb49d46 tempest-VolumesSnapshotTestJSON-532061065 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.85e65111-cf77-4db0-b96c-bf903aded27f is being set with open permissions: ugo+rw Apr 29 17:31:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2ae31933-35c6-4e55-8f16-7757ddb49d46 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.85e65111-cf77-4db0-b96c-bf903aded27f {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:07 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.85e65111-cf77-4db0-b96c-bf903aded27f Apr 29 17:31:07 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:07 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2ae31933-35c6-4e55-8f16-7757ddb49d46 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.85e65111-cf77-4db0-b96c-bf903aded27f" returned: 0 in 0.716s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2ae31933-35c6-4e55-8f16-7757ddb49d46 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:07 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.info Apr 29 17:31:07 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:08 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2ae31933-35c6-4e55-8f16-7757ddb49d46 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.info" returned: 0 in 0.862s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:08 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-2ae31933-35c6-4e55-8f16-7757ddb49d46 tempest-VolumesSnapshotTestJSON-532061065 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.info is being set with open permissions: ugo+rw Apr 29 17:31:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2ae31933-35c6-4e55-8f16-7757ddb49d46 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:08 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.info Apr 29 17:31:08 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:09 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2ae31933-35c6-4e55-8f16-7757ddb49d46 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.info" returned: 0 in 0.894s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2ae31933-35c6-4e55-8f16-7757ddb49d46 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.254s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f32bbe04-fa60-434f-b3a0-2179223b6dbf tempest-SnapshotDependencyTests-1720259262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.637s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-f32bbe04-fa60-434f-b3a0-2179223b6dbf tempest-SnapshotDependencyTests-1720259262 None] Creating offline snapshot efcaad8c-3d80-41f2-af3d-9852a218d515 of volume c768ff76-fbc6-4b91-9dde-f84ef8d154f4 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:31:09 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bdfa66-5dd7-41ab-9e0d-8ac4a891e763]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f32bbe04-fa60-434f-b3a0-2179223b6dbf tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:09 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-2ae31933-35c6-4e55-8f16-7757ddb49d46 tempest-VolumesSnapshotTestJSON-532061065 None] Create snapshot completed successfully Apr 29 17:31:09 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 Apr 29 17:31:09 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:10 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-85e65111-cf77-4db0-b96c-bf903aded27f-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:10 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-85e65111-cf77-4db0-b96c-bf903aded27f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:10 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f32bbe04-fa60-434f-b3a0-2179223b6dbf tempest-SnapshotDependencyTests-1720259262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4" returned: 0 in 1.013s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f32bbe04-fa60-434f-b3a0-2179223b6dbf tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:10 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-quobyte-577b2026-7de5-4ead-a86c-8e09e96c4ed2" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:10 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515 1G Apr 29 17:31:10 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:10 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-577b2026-7de5-4ead-a86c-8e09e96c4ed2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:10 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-quobyte-85e65111-cf77-4db0-b96c-bf903aded27f" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:10 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-85e65111-cf77-4db0-b96c-bf903aded27f" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] Deleting offline snapshot 85e65111-cf77-4db0-b96c-bf903aded27f of volume 577b2026-7de5-4ead-a86c-8e09e96c4ed2 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:31:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] snapshot_file for this snap is: volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.85e65111-cf77-4db0-b96c-bf903aded27f {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:31:10 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb6ee01-6211-41b6-b6cb-bc22bda5e3ed]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.85e65111-cf77-4db0-b96c-bf903aded27f {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:11 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.85e65111-cf77-4db0-b96c-bf903aded27f Apr 29 17:31:11 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:11 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.85e65111-cf77-4db0-b96c-bf903aded27f" returned: 0 in 1.058s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:31:11 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f10be7-c44a-40fe-8559-ba63c4943e12]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:11 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f32bbe04-fa60-434f-b3a0-2179223b6dbf tempest-SnapshotDependencyTests-1720259262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515 1G" returned: 0 in 1.317s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f32bbe04-fa60-434f-b3a0-2179223b6dbf tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:12 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515 Apr 29 17:31:12 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:12 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2 Apr 29 17:31:12 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-2e1e395b-8479-4d11-93fb-e87d1b4eded4 tempest-BackendsCapabilitiesAdminTestsJSON-1679701465 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5835762023926, 'free_capacity_gb': 1775.5835762023926, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84547) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 29 17:31:12 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2" returned: 0 in 0.887s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.85e65111-cf77-4db0-b96c-bf903aded27f {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:12 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.85e65111-cf77-4db0-b96c-bf903aded27f Apr 29 17:31:12 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:12 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f32bbe04-fa60-434f-b3a0-2179223b6dbf tempest-SnapshotDependencyTests-1720259262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515" returned: 0 in 0.865s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:12 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-f32bbe04-fa60-434f-b3a0-2179223b6dbf tempest-SnapshotDependencyTests-1720259262 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515 is being set with open permissions: ugo+rw Apr 29 17:31:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f32bbe04-fa60-434f-b3a0-2179223b6dbf tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:12 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515 Apr 29 17:31:12 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6947e959-bf21-42c1-a5ae-6ec97a52acf8 tempest-BackendsCapabilitiesAdminTestsJSON-1679701465 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.5835762023926, 'free_capacity_gb': 1775.5835762023926, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84547) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 29 17:31:13 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f32bbe04-fa60-434f-b3a0-2179223b6dbf tempest-SnapshotDependencyTests-1720259262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515" returned: 0 in 0.838s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f32bbe04-fa60-434f-b3a0-2179223b6dbf tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:13 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.85e65111-cf77-4db0-b96c-bf903aded27f" returned: 0 in 0.981s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.85e65111-cf77-4db0-b96c-bf903aded27f {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:13 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.info Apr 29 17:31:13 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:13 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.85e65111-cf77-4db0-b96c-bf903aded27f Apr 29 17:31:13 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:14 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f32bbe04-fa60-434f-b3a0-2179223b6dbf tempest-SnapshotDependencyTests-1720259262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.info" returned: 0 in 0.834s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:14 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:14 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-f32bbe04-fa60-434f-b3a0-2179223b6dbf tempest-SnapshotDependencyTests-1720259262 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.info is being set with open permissions: ugo+rw Apr 29 17:31:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f32bbe04-fa60-434f-b3a0-2179223b6dbf tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2.85e65111-cf77-4db0-b96c-bf903aded27f" returned: 0 in 0.830s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:14 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.info Apr 29 17:31:14 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:14 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-85e65111-cf77-4db0-b96c-bf903aded27f" released by "_delete_snapshot" :: held 3.917s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:14 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-577b2026-7de5-4ead-a86c-8e09e96c4ed2" released by "delete_snapshot" :: held 3.956s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:14 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] Created reservations ['390490d5-354e-42e2-86f2-0a26170a0a2d', '243b0560-b89e-4f1b-a6dc-f8732ec281aa', '54758831-5978-42c8-8ba9-f9334079ba7b', '49070388-002c-4a48-b9de-ea2506ce84e6'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:31:14 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] Delete snapshot completed successfully. Apr 29 17:31:14 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-7e7774ed-dec3-439d-b108-38a4009cee4f tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-85e65111-cf77-4db0-b96c-bf903aded27f-delete_snapshot" released by "delete_snapshot" :: held 4.278s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:15 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f32bbe04-fa60-434f-b3a0-2179223b6dbf tempest-SnapshotDependencyTests-1720259262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.info" returned: 0 in 0.889s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f32bbe04-fa60-434f-b3a0-2179223b6dbf tempest-SnapshotDependencyTests-1720259262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.947s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:15 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f32bbe04-fa60-434f-b3a0-2179223b6dbf tempest-SnapshotDependencyTests-1720259262 None] Create snapshot completed successfully Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Flow 'volume_create_manager' (4fc35faf-3db6-469b-9794-8f5f97046895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537ea8ac-b9e2-4d94-994c-b0ab9478a64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (537ea8ac-b9e2-4d94-994c-b0ab9478a64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1205411714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77efeec60544d47bdcf52e70ae40517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:31:16Z,use_quota=True,user_id='ba9bb61d783e468dbc781aa7ca9c8213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8639dc94-4c15-4708-b2a6-906322ad117c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8639dc94-4c15-4708-b2a6-906322ad117c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b54ce0-d4a3-43e5-ba22-84ad56933194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b54ce0-d4a3-43e5-ba22-84ad56933194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59', 'volume_name': 'volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (254c9484-6893-4832-b216-a57829124274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (254c9484-6893-4832-b216-a57829124274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3039e8-f5dd-4a19-90a1-f5e2d31f427c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:15 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Volume c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59', 'volume_size': 1} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1205411714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77efeec60544d47bdcf52e70ae40517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:31:16Z,use_quota=True,user_id='ba9bb61d783e468dbc781aa7ca9c8213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Creating volume c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:31:15 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:31:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:15 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 1073741824 Apr 29 17:31:15 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:16 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 1073741824" returned: 0 in 1.090s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:16 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 Apr 29 17:31:16 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Flow 'volume_create_manager' (d8b19b43-a1b9-4800-881c-7c0facbedb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55893a84-eba9-4c45-891d-96ad05ab90cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55893a84-eba9-4c45-891d-96ad05ab90cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a943001d-0ba2-4192-90dc-b2f0fcb283cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dfbd524238049ad928c07768065894b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:31:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=efcaad8c-3d80-41f2-af3d-9852a218d515,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:31:17Z,use_quota=True,user_id='5bd53c3270744d599cc95e1cf261a5b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd0d25e-440c-4c15-8ad0-6dde0024e5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd0d25e-440c-4c15-8ad0-6dde0024e5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c83b974-a754-4e33-a555-73da44437c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c83b974-a754-4e33-a555-73da44437c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a943001d-0ba2-4192-90dc-b2f0fcb283cd', 'volume_name': 'volume-a943001d-0ba2-4192-90dc-b2f0fcb283cd', 'volume_size': 1, 'snapshot_id': 'efcaad8c-3d80-41f2-af3d-9852a218d515'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7f1dfb-2b6d-40dc-98f3-2e0456deddc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7f1dfb-2b6d-40dc-98f3-2e0456deddc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e106c80-c6bc-4767-a501-182694842d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:17 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Volume a943001d-0ba2-4192-90dc-b2f0fcb283cd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a943001d-0ba2-4192-90dc-b2f0fcb283cd', 'volume_size': 1, 'snapshot_id': 'efcaad8c-3d80-41f2-af3d-9852a218d515'} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:17 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59" returned: 0 in 0.792s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.223s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Acquiring lock "cinder-quobyte-efcaad8c-3d80-41f2-af3d-9852a218d515-a943001d-0ba2-4192-90dc-b2f0fcb283cd" by "_create_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3039e8-f5dd-4a19-90a1-f5e2d31f427c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c41700-46ce-41f5-8c6c-0eff1522b9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Lock "cinder-quobyte-efcaad8c-3d80-41f2-af3d-9852a218d515-a943001d-0ba2-4192-90dc-b2f0fcb283cd" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Creating volume a943001d-0ba2-4192-90dc-b2f0fcb283cd from snapshot efcaad8c-3d80-41f2-af3d-9852a218d515 {{(pid=84547) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Acquiring lock "cinder-quobyte-a943001d-0ba2-4192-90dc-b2f0fcb283cd" by "_copy_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:17 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Volume volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 (c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59): created successfully Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c41700-46ce-41f5-8c6c-0eff1522b9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Flow 'volume_create_manager' (4fc35faf-3db6-469b-9794-8f5f97046895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Lock "cinder-quobyte-a943001d-0ba2-4192-90dc-b2f0fcb283cd" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] snapshot: efcaad8c-3d80-41f2-af3d-9852a218d515, volume: a943001d-0ba2-4192-90dc-b2f0fcb283cd, {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:17 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-beea0092-b8d2-41aa-bc79-a4041404dcd5 tempest-VolumesSnapshotTestJSON-532061065 None] Created volume successfully. Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[327cc506-47d6-456c-b216-ca31ba426286]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:18 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515 Apr 29 17:31:18 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:18 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515" returned: 0 in 0.848s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:31:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 17:31:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Creating direct copy from snapshot {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 17:31:18 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a981357-a530-4879-89bf-4f4155b5d010]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:18 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 Apr 29 17:31:18 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-500cc7cb-24ea-496a-8525-8236f9f216a9 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:19 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4" returned: 0 in 0.810s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:19 devstack cinder-volume[84547]: DEBUG cinder.utils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Path /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a943001d-0ba2-4192-90dc-b2f0fcb283cd not found in is_blk_device check {{(pid=84547) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 17:31:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a943001d-0ba2-4192-90dc-b2f0fcb283cd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:19 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a943001d-0ba2-4192-90dc-b2f0fcb283cd Apr 29 17:31:19 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:24 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a943001d-0ba2-4192-90dc-b2f0fcb283cd" returned: 0 in 5.416s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:25 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa3eac1-d5f6-48b7-b823-ca5ef677e151]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:25 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 Apr 29 17:31:25 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:25 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4" returned: 0 in 0.931s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:25 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a943001d-0ba2-4192-90dc-b2f0fcb283cd {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:31:25 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Converted 1024.00 MB image at 189.00 MB/s Apr 29 17:31:25 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a943001d-0ba2-4192-90dc-b2f0fcb283cd is being set with open permissions: ugo+rw Apr 29 17:31:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a943001d-0ba2-4192-90dc-b2f0fcb283cd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:25 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a943001d-0ba2-4192-90dc-b2f0fcb283cd Apr 29 17:31:25 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:26 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a943001d-0ba2-4192-90dc-b2f0fcb283cd" returned: 0 in 0.594s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Lock "cinder-quobyte-a943001d-0ba2-4192-90dc-b2f0fcb283cd" released by "_copy_volume_from_snapshot" :: held 8.715s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Lock "cinder-quobyte-efcaad8c-3d80-41f2-af3d-9852a218d515-a943001d-0ba2-4192-90dc-b2f0fcb283cd" released by "_create_volume_from_snapshot" :: held 8.776s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.819s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-500cc7cb-24ea-496a-8525-8236f9f216a9 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.431s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:26 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=62,cinder:UPDATE=58,cinder:INSERT=20,cinder:DELETE=5 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:31:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-500cc7cb-24ea-496a-8525-8236f9f216a9 tempest-VolumesSnapshotTestJSON-532061065 None] Creating offline snapshot c571e879-88d2-4f04-ba9a-36ed53daa29e of volume c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:31:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e106c80-c6bc-4767-a501-182694842d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a943001d-0ba2-4192-90dc-b2f0fcb283cd', 'volume_size': 1, 'snapshot_id': 'efcaad8c-3d80-41f2-af3d-9852a218d515'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ff5db6-6d77-417d-bb25-2cf07a3cd14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:26 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[264163a9-150c-4aab-acf8-1afa4e894b14]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-500cc7cb-24ea-496a-8525-8236f9f216a9 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:26 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Volume volume-a943001d-0ba2-4192-90dc-b2f0fcb283cd (a943001d-0ba2-4192-90dc-b2f0fcb283cd): created successfully Apr 29 17:31:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ff5db6-6d77-417d-bb25-2cf07a3cd14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Flow 'volume_create_manager' (d8b19b43-a1b9-4800-881c-7c0facbedb26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:31:26 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-c2391df2-23b3-444f-85fd-9764a0f221e6 tempest-SnapshotDependencyTests-1720259262 None] Created volume successfully. Apr 29 17:31:26 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 Apr 29 17:31:26 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:27 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-500cc7cb-24ea-496a-8525-8236f9f216a9 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59" returned: 0 in 0.738s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-500cc7cb-24ea-496a-8525-8236f9f216a9 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:27 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e 1G Apr 29 17:31:27 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] Acquiring lock "cinder-efcaad8c-3d80-41f2-af3d-9852a218d515-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] Lock "cinder-efcaad8c-3d80-41f2-af3d-9852a218d515-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] Acquiring lock "cinder-quobyte-c768ff76-fbc6-4b91-9dde-f84ef8d154f4" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] Lock "cinder-quobyte-c768ff76-fbc6-4b91-9dde-f84ef8d154f4" acquired by "delete_snapshot" :: waited 0.039s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] Acquiring lock "cinder-quobyte-efcaad8c-3d80-41f2-af3d-9852a218d515" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] Lock "cinder-quobyte-efcaad8c-3d80-41f2-af3d-9852a218d515" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:27 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] Deleting offline snapshot efcaad8c-3d80-41f2-af3d-9852a218d515 of volume c768ff76-fbc6-4b91-9dde-f84ef8d154f4 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:31:27 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] snapshot_file for this snap is: volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:31:27 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cc75a8-d1f8-40e2-a76b-447e8b0b4b62]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:27 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515 Apr 29 17:31:27 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:28 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-500cc7cb-24ea-496a-8525-8236f9f216a9 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e 1G" returned: 0 in 0.818s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-500cc7cb-24ea-496a-8525-8236f9f216a9 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:28 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e Apr 29 17:31:28 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:28 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515" returned: 0 in 0.794s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:31:28 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[f995e63d-5ddf-4165-aad7-5ee8d0eb6dea]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:28 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:31:28 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Flow 'volume_create_manager' (11285c86-6d10-4158-b72f-8bde7fe8857c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:31:28 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f28fc8-e89a-4618-bcc0-ea8310444b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:28 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f28fc8-e89a-4618-bcc0-ea8310444b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-308821562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130faeba-dd31-4e6b-b801-679ea4777692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff10624a64e4f2cba5e66ee63ee9f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:31:28Z,use_quota=True,user_id='53f0bca1300d48fb9248f1a14e2540b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75b6265a-98ba-4b23-aa05-feffa75db899),volume_type_id=75b6265a-98ba-4b23-aa05-feffa75db899)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:28 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddc40d3-4509-4822-9803-999e27b9a8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:28 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddc40d3-4509-4822-9803-999e27b9a8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:28 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e312249-441d-442c-94b0-5ce06d00401d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:28 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e312249-441d-442c-94b0-5ce06d00401d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '130faeba-dd31-4e6b-b801-679ea4777692', 'volume_name': 'volume-130faeba-dd31-4e6b-b801-679ea4777692', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:28 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c987084a-4b83-4326-a9da-548991e69d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:28 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c987084a-4b83-4326-a9da-548991e69d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:28 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf3fdc8a-9732-4cea-88a6-077b3b62b9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:28 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Volume 130faeba-dd31-4e6b-b801-679ea4777692: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-130faeba-dd31-4e6b-b801-679ea4777692', 'volume_size': 1} Apr 29 17:31:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:28 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 Apr 29 17:31:28 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:28 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-500cc7cb-24ea-496a-8525-8236f9f216a9 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e" returned: 0 in 0.781s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:28 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-500cc7cb-24ea-496a-8525-8236f9f216a9 tempest-VolumesSnapshotTestJSON-532061065 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e is being set with open permissions: ugo+rw Apr 29 17:31:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-500cc7cb-24ea-496a-8525-8236f9f216a9 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:28 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e Apr 29 17:31:28 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:29 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4" returned: 0 in 0.775s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:29 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515 Apr 29 17:31:29 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:29 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-500cc7cb-24ea-496a-8525-8236f9f216a9 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e" returned: 0 in 0.619s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-500cc7cb-24ea-496a-8525-8236f9f216a9 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:29 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.info Apr 29 17:31:29 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:29 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515" returned: 0 in 0.703s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:30 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515 Apr 29 17:31:30 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:30 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-500cc7cb-24ea-496a-8525-8236f9f216a9 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.info" returned: 0 in 0.622s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:30 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-500cc7cb-24ea-496a-8525-8236f9f216a9 tempest-VolumesSnapshotTestJSON-532061065 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.info is being set with open permissions: ugo+rw Apr 29 17:31:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-500cc7cb-24ea-496a-8525-8236f9f216a9 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:30 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.info Apr 29 17:31:30 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:30 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4.efcaad8c-3d80-41f2-af3d-9852a218d515" returned: 0 in 0.598s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] Lock "cinder-quobyte-efcaad8c-3d80-41f2-af3d-9852a218d515" released by "_delete_snapshot" :: held 3.061s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] Lock "cinder-quobyte-c768ff76-fbc6-4b91-9dde-f84ef8d154f4" released by "delete_snapshot" :: held 3.084s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:30 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] Created reservations ['77a03aaa-818f-4c59-8e2f-c0663612ddf8', 'f30158c2-f225-4682-97d8-ce7f227a8237', 'fcf9e18c-271c-4976-b978-6870bf672545', 'e99c9065-67c0-4e0e-bfee-698879254b61'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:31:30 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] Delete snapshot completed successfully. Apr 29 17:31:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-58745fbc-2b99-490f-ba0e-d9fe12196345 tempest-SnapshotDependencyTests-1720259262 None] Lock "cinder-efcaad8c-3d80-41f2-af3d-9852a218d515-delete_snapshot" released by "delete_snapshot" :: held 3.298s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:30 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-500cc7cb-24ea-496a-8525-8236f9f216a9 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.info" returned: 0 in 0.641s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-500cc7cb-24ea-496a-8525-8236f9f216a9 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.336s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.235s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-308821562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130faeba-dd31-4e6b-b801-679ea4777692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff10624a64e4f2cba5e66ee63ee9f80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:31:28Z,use_quota=True,user_id='53f0bca1300d48fb9248f1a14e2540b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75b6265a-98ba-4b23-aa05-feffa75db899),volume_type_id=75b6265a-98ba-4b23-aa05-feffa75db899)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:31:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Creating volume 130faeba-dd31-4e6b-b801-679ea4777692 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:31:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:31:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:31:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:31:30 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:31:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-130faeba-dd31-4e6b-b801-679ea4777692 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:30 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-130faeba-dd31-4e6b-b801-679ea4777692 1073741824 Apr 29 17:31:30 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:30 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-500cc7cb-24ea-496a-8525-8236f9f216a9 tempest-VolumesSnapshotTestJSON-532061065 None] Create snapshot completed successfully Apr 29 17:31:31 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-130faeba-dd31-4e6b-b801-679ea4777692 1073741824" returned: 0 in 0.791s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-130faeba-dd31-4e6b-b801-679ea4777692 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:31 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-130faeba-dd31-4e6b-b801-679ea4777692 Apr 29 17:31:31 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8c37c6c2-9eab-4936-8e3e-1134f282db51 tempest-SnapshotDependencyTests-1720259262 None] Acquiring lock "cinder-c768ff76-fbc6-4b91-9dde-f84ef8d154f4-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8c37c6c2-9eab-4936-8e3e-1134f282db51 tempest-SnapshotDependencyTests-1720259262 None] Lock "cinder-c768ff76-fbc6-4b91-9dde-f84ef8d154f4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8c37c6c2-9eab-4936-8e3e-1134f282db51 tempest-SnapshotDependencyTests-1720259262 None] Acquiring lock "cinder-quobyte-c768ff76-fbc6-4b91-9dde-f84ef8d154f4" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:31 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8c37c6c2-9eab-4936-8e3e-1134f282db51 tempest-SnapshotDependencyTests-1720259262 None] Lock "cinder-quobyte-c768ff76-fbc6-4b91-9dde-f84ef8d154f4" acquired by "delete_volume" :: waited 0.021s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:31 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6a02f2-0b8e-4718-acfa-1054874ec8f7]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8c37c6c2-9eab-4936-8e3e-1134f282db51 tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:32 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 Apr 29 17:31:32 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Flow 'volume_create_manager' (86dbc47a-72f9-4d14-8bd6-72f09ddcd831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e47571-5639-4a58-ac34-3754e9f7a228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e47571-5639-4a58-ac34-3754e9f7a228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:31:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1103364911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b5de69-0df8-4e5a-8bc1-6398111473fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77efeec60544d47bdcf52e70ae40517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:31:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c571e879-88d2-4f04-ba9a-36ed53daa29e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:31:32Z,use_quota=True,user_id='ba9bb61d783e468dbc781aa7ca9c8213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed51b50-f449-4ae6-9abe-1b46e7d6d98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed51b50-f449-4ae6-9abe-1b46e7d6d98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de20ccc5-c634-4650-891e-0214a6a89284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de20ccc5-c634-4650-891e-0214a6a89284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd7b5de69-0df8-4e5a-8bc1-6398111473fb', 'volume_name': 'volume-d7b5de69-0df8-4e5a-8bc1-6398111473fb', 'volume_size': 2, 'snapshot_id': 'c571e879-88d2-4f04-ba9a-36ed53daa29e'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac1f449-578c-46f9-aa5d-76b34149f31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac1f449-578c-46f9-aa5d-76b34149f31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee3e595-a6bd-40fb-917f-650ece8647b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:32 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Volume d7b5de69-0df8-4e5a-8bc1-6398111473fb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d7b5de69-0df8-4e5a-8bc1-6398111473fb', 'volume_size': 2, 'snapshot_id': 'c571e879-88d2-4f04-ba9a-36ed53daa29e'} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:32 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-130faeba-dd31-4e6b-b801-679ea4777692" returned: 0 in 0.883s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.012s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-quobyte-c571e879-88d2-4f04-ba9a-36ed53daa29e-d7b5de69-0df8-4e5a-8bc1-6398111473fb" by "_create_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-c571e879-88d2-4f04-ba9a-36ed53daa29e-d7b5de69-0df8-4e5a-8bc1-6398111473fb" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Creating volume d7b5de69-0df8-4e5a-8bc1-6398111473fb from snapshot c571e879-88d2-4f04-ba9a-36ed53daa29e {{(pid=84547) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-quobyte-d7b5de69-0df8-4e5a-8bc1-6398111473fb" by "_copy_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf3fdc8a-9732-4cea-88a6-077b3b62b9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-130faeba-dd31-4e6b-b801-679ea4777692', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8349f827-745a-463c-8c33-537778e7de61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-d7b5de69-0df8-4e5a-8bc1-6398111473fb" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] snapshot: c571e879-88d2-4f04-ba9a-36ed53daa29e, volume: d7b5de69-0df8-4e5a-8bc1-6398111473fb, {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 17:31:32 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Volume volume-130faeba-dd31-4e6b-b801-679ea4777692 (130faeba-dd31-4e6b-b801-679ea4777692): created successfully Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8349f827-745a-463c-8c33-537778e7de61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Flow 'volume_create_manager' (11285c86-6d10-4158-b72f-8bde7fe8857c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:32 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-fbdff6cc-b528-45a8-958f-4d676e939be3 tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Created volume successfully. Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[f770882b-d4db-4b35-9c95-dc79d786ac00]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:32 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8c37c6c2-9eab-4936-8e3e-1134f282db51 tempest-SnapshotDependencyTests-1720259262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4" returned: 0 in 0.909s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:32 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e Apr 29 17:31:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8c37c6c2-9eab-4936-8e3e-1134f282db51 tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:32 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:32 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4 Apr 29 17:31:32 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:33 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:33 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e" returned: 0 in 0.733s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:31:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 17:31:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Creating direct copy from snapshot {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 17:31:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8c37c6c2-9eab-4936-8e3e-1134f282db51 tempest-SnapshotDependencyTests-1720259262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c768ff76-fbc6-4b91-9dde-f84ef8d154f4" returned: 0 in 0.631s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:33 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[520a450a-5112-4634-b9ed-d855badd6b3c]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:33 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8c37c6c2-9eab-4936-8e3e-1134f282db51 tempest-SnapshotDependencyTests-1720259262 None] Lock "cinder-quobyte-c768ff76-fbc6-4b91-9dde-f84ef8d154f4" released by "delete_volume" :: held 1.625s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:33 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-8c37c6c2-9eab-4936-8e3e-1134f282db51 tempest-SnapshotDependencyTests-1720259262 None] Created reservations ['b19f82a6-c514-4ec5-b74c-535e88f2911c', 'a6d16b74-e5bf-4fa8-a72c-dfc153bb2263', 'e6c53a58-ce73-4826-a6f9-d0629d574176', 'cfdce6b5-20a1-4e94-9fb1-c516e8c9ca88'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:31:33 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 Apr 29 17:31:33 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8c37c6c2-9eab-4936-8e3e-1134f282db51 tempest-SnapshotDependencyTests-1720259262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8c37c6c2-9eab-4936-8e3e-1134f282db51 tempest-SnapshotDependencyTests-1720259262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8c37c6c2-9eab-4936-8e3e-1134f282db51 tempest-SnapshotDependencyTests-1720259262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:31:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8c37c6c2-9eab-4936-8e3e-1134f282db51 tempest-SnapshotDependencyTests-1720259262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:31:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8c37c6c2-9eab-4936-8e3e-1134f282db51 tempest-SnapshotDependencyTests-1720259262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8c37c6c2-9eab-4936-8e3e-1134f282db51 tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:33 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:31:33 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-375f79e2-26ab-4d2c-a091-ac2ab842c951 tempest-SnapshotDependencyTests-1720259262 None] Acquiring lock "cinder-a943001d-0ba2-4192-90dc-b2f0fcb283cd-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-375f79e2-26ab-4d2c-a091-ac2ab842c951 tempest-SnapshotDependencyTests-1720259262 None] Lock "cinder-a943001d-0ba2-4192-90dc-b2f0fcb283cd-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-375f79e2-26ab-4d2c-a091-ac2ab842c951 tempest-SnapshotDependencyTests-1720259262 None] Acquiring lock "cinder-quobyte-a943001d-0ba2-4192-90dc-b2f0fcb283cd" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-375f79e2-26ab-4d2c-a091-ac2ab842c951 tempest-SnapshotDependencyTests-1720259262 None] Lock "cinder-quobyte-a943001d-0ba2-4192-90dc-b2f0fcb283cd" acquired by "delete_volume" :: waited 0.023s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:34 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1a2fbf-9e9c-4221-9786-504c1ba65401]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-375f79e2-26ab-4d2c-a091-ac2ab842c951 tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a943001d-0ba2-4192-90dc-b2f0fcb283cd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:34 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8c37c6c2-9eab-4936-8e3e-1134f282db51 tempest-SnapshotDependencyTests-1720259262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.676s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:34 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-8c37c6c2-9eab-4936-8e3e-1134f282db51 tempest-SnapshotDependencyTests-1720259262 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:31:34 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:34 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-8c37c6c2-9eab-4936-8e3e-1134f282db51 tempest-SnapshotDependencyTests-1720259262 None] Deleted volume successfully. Apr 29 17:31:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59" returned: 0 in 0.830s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:34 devstack cinder-volume[84547]: DEBUG cinder.utils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Path /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d7b5de69-0df8-4e5a-8bc1-6398111473fb not found in is_blk_device check {{(pid=84547) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 17:31:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d7b5de69-0df8-4e5a-8bc1-6398111473fb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:34 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d7b5de69-0df8-4e5a-8bc1-6398111473fb Apr 29 17:31:34 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8c37c6c2-9eab-4936-8e3e-1134f282db51 tempest-SnapshotDependencyTests-1720259262 None] Lock "cinder-c768ff76-fbc6-4b91-9dde-f84ef8d154f4-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-942b7872-4928-4962-8d56-9debdff4e6cc tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-942b7872-4928-4962-8d56-9debdff4e6cc tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:34 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-942b7872-4928-4962-8d56-9debdff4e6cc tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:31:34 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-942b7872-4928-4962-8d56-9debdff4e6cc tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:31:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-942b7872-4928-4962-8d56-9debdff4e6cc tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-942b7872-4928-4962-8d56-9debdff4e6cc tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:34 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:31:34 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:34 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a943001d-0ba2-4192-90dc-b2f0fcb283cd Apr 29 17:31:34 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:35 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-942b7872-4928-4962-8d56-9debdff4e6cc tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.699s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:35 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-942b7872-4928-4962-8d56-9debdff4e6cc tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:31:35 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-942b7872-4928-4962-8d56-9debdff4e6cc tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Retype volume completed successfully. Apr 29 17:31:35 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-375f79e2-26ab-4d2c-a091-ac2ab842c951 tempest-SnapshotDependencyTests-1720259262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a943001d-0ba2-4192-90dc-b2f0fcb283cd" returned: 0 in 0.884s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-375f79e2-26ab-4d2c-a091-ac2ab842c951 tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a943001d-0ba2-4192-90dc-b2f0fcb283cd {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:35 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a943001d-0ba2-4192-90dc-b2f0fcb283cd Apr 29 17:31:35 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:36 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Acquiring lock "cinder-130faeba-dd31-4e6b-b801-679ea4777692-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:36 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Lock "cinder-130faeba-dd31-4e6b-b801-679ea4777692-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-51442488-81a8-4738-9472-694721da7a87 req-fb62d3b5-ce5e-44ec-bf6f-13cb5d481007 tempest-TestStampPattern-1991106930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:36 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Acquiring lock "cinder-quobyte-130faeba-dd31-4e6b-b801-679ea4777692" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:36 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Lock "cinder-quobyte-130faeba-dd31-4e6b-b801-679ea4777692" acquired by "delete_volume" :: waited 0.035s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:36 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b21bb0-f6e0-4dbe-8db5-a62628ab7518]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-130faeba-dd31-4e6b-b801-679ea4777692 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:36 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-130faeba-dd31-4e6b-b801-679ea4777692 Apr 29 17:31:36 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:37 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-375f79e2-26ab-4d2c-a091-ac2ab842c951 tempest-SnapshotDependencyTests-1720259262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-a943001d-0ba2-4192-90dc-b2f0fcb283cd" returned: 0 in 1.840s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:37 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-375f79e2-26ab-4d2c-a091-ac2ab842c951 tempest-SnapshotDependencyTests-1720259262 None] Lock "cinder-quobyte-a943001d-0ba2-4192-90dc-b2f0fcb283cd" released by "delete_volume" :: held 2.785s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:37 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-375f79e2-26ab-4d2c-a091-ac2ab842c951 tempest-SnapshotDependencyTests-1720259262 None] Created reservations ['a883631b-70e8-4336-95d1-19e162f99bbb', '7338536f-2f8a-4e92-9613-b60d7c18994e', 'd3d2ab5f-a6eb-4155-8925-0de2e0d566e9', '24a22ebf-cc11-4fa0-bac4-6db8a03af996'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:31:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-375f79e2-26ab-4d2c-a091-ac2ab842c951 tempest-SnapshotDependencyTests-1720259262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-375f79e2-26ab-4d2c-a091-ac2ab842c951 tempest-SnapshotDependencyTests-1720259262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-375f79e2-26ab-4d2c-a091-ac2ab842c951 tempest-SnapshotDependencyTests-1720259262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:31:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-375f79e2-26ab-4d2c-a091-ac2ab842c951 tempest-SnapshotDependencyTests-1720259262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:31:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-375f79e2-26ab-4d2c-a091-ac2ab842c951 tempest-SnapshotDependencyTests-1720259262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-375f79e2-26ab-4d2c-a091-ac2ab842c951 tempest-SnapshotDependencyTests-1720259262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:37 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:31:37 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:37 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-130faeba-dd31-4e6b-b801-679ea4777692" returned: 0 in 1.380s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-130faeba-dd31-4e6b-b801-679ea4777692 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:37 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-130faeba-dd31-4e6b-b801-679ea4777692 Apr 29 17:31:37 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:38 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-375f79e2-26ab-4d2c-a091-ac2ab842c951 tempest-SnapshotDependencyTests-1720259262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.453s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:38 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-375f79e2-26ab-4d2c-a091-ac2ab842c951 tempest-SnapshotDependencyTests-1720259262 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:31:38 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-375f79e2-26ab-4d2c-a091-ac2ab842c951 tempest-SnapshotDependencyTests-1720259262 None] Deleted volume successfully. Apr 29 17:31:38 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-375f79e2-26ab-4d2c-a091-ac2ab842c951 tempest-SnapshotDependencyTests-1720259262 None] Lock "cinder-a943001d-0ba2-4192-90dc-b2f0fcb283cd-delete_volume" released by "delete_volume" :: held 4.765s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:39 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-130faeba-dd31-4e6b-b801-679ea4777692" returned: 0 in 1.253s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:39 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Lock "cinder-quobyte-130faeba-dd31-4e6b-b801-679ea4777692" released by "delete_volume" :: held 2.735s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:39 devstack cinder-volume[84547]: WARNING cinder.quota [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:31:39 devstack cinder-volume[84547]: WARNING cinder.quota [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:31:39 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Created reservations ['1b245507-2443-440e-91a9-42526d6c2f1f', '3bc9f270-413b-4231-9c57-bf8feb50cc06', '4ffa2d83-eda1-4087-9a0e-63b8fff95942', 'dd6ded23-b440-4eee-b7ff-7febc1605649'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:31:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:31:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:31:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:39 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:31:39 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:40 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d7b5de69-0df8-4e5a-8bc1-6398111473fb" returned: 0 in 6.533s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:40 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.387s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:40 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:31:40 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ea2b7c-3aae-4d79-b78d-3adbfc8f51d7]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:40 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Deleted volume successfully. Apr 29 17:31:40 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ba7ddf92-6461-4c67-9a1f-1e8e6dc5db2c tempest-VolumeRetypeWithoutMigrationTest-1052803232 None] Lock "cinder-130faeba-dd31-4e6b-b801-679ea4777692-delete_volume" released by "delete_volume" :: held 4.669s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:41 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 Apr 29 17:31:41 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:41 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59" returned: 0 in 1.009s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:41 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59, size 1024.00 MB, duration 6.53 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d7b5de69-0df8-4e5a-8bc1-6398111473fb {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:31:41 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Converted 1024.00 MB image at 156.70 MB/s Apr 29 17:31:41 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d7b5de69-0df8-4e5a-8bc1-6398111473fb is being set with open permissions: ugo+rw Apr 29 17:31:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d7b5de69-0df8-4e5a-8bc1-6398111473fb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:41 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d7b5de69-0df8-4e5a-8bc1-6398111473fb Apr 29 17:31:41 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:42 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d7b5de69-0df8-4e5a-8bc1-6398111473fb" returned: 0 in 0.750s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-d7b5de69-0df8-4e5a-8bc1-6398111473fb" released by "_copy_volume_from_snapshot" :: held 9.996s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-c571e879-88d2-4f04-ba9a-36ed53daa29e-d7b5de69-0df8-4e5a-8bc1-6398111473fb" released by "_create_volume_from_snapshot" :: held 10.055s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.077s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-51442488-81a8-4738-9472-694721da7a87 req-fb62d3b5-ce5e-44ec-bf6f-13cb5d481007 tempest-TestStampPattern-1991106930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.406s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:42 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=85,cinder:UPDATE=91,cinder:DELETE=10,cinder:INSERT=17 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:31:42 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5daf83-c94f-46bb-ae1d-14c2281f8ccb]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-51442488-81a8-4738-9472-694721da7a87 req-fb62d3b5-ce5e-44ec-bf6f-13cb5d481007 tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee3e595-a6bd-40fb-917f-650ece8647b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7b5de69-0df8-4e5a-8bc1-6398111473fb', 'volume_size': 2, 'snapshot_id': 'c571e879-88d2-4f04-ba9a-36ed53daa29e'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313a2dce-1087-4834-a82c-f275869eefe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:42 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Volume volume-d7b5de69-0df8-4e5a-8bc1-6398111473fb (d7b5de69-0df8-4e5a-8bc1-6398111473fb): created successfully Apr 29 17:31:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313a2dce-1087-4834-a82c-f275869eefe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Flow 'volume_create_manager' (86dbc47a-72f9-4d14-8bd6-72f09ddcd831) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:31:42 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-33190404-ac3b-47f9-ac8e-9b16047de38c tempest-VolumesSnapshotTestJSON-532061065 None] Created volume successfully. Apr 29 17:31:42 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798 Apr 29 17:31:42 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:43 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-51442488-81a8-4738-9472-694721da7a87 req-fb62d3b5-ce5e-44ec-bf6f-13cb5d481007 tempest-TestStampPattern-1991106930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798" returned: 0 in 0.956s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-51442488-81a8-4738-9472-694721da7a87 req-fb62d3b5-ce5e-44ec-bf6f-13cb5d481007 tempest-TestStampPattern-1991106930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.982s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:43 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-816d403a-0c01-4c11-ac9e-3911977e54b8 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-d7b5de69-0df8-4e5a-8bc1-6398111473fb-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-51442488-81a8-4738-9472-694721da7a87 req-fb62d3b5-ce5e-44ec-bf6f-13cb5d481007 tempest-TestStampPattern-1991106930 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '055f9b2a-3849-44ef-a71d-badd3e961897', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:31:43 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-816d403a-0c01-4c11-ac9e-3911977e54b8 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-d7b5de69-0df8-4e5a-8bc1-6398111473fb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:43 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-816d403a-0c01-4c11-ac9e-3911977e54b8 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-quobyte-d7b5de69-0df8-4e5a-8bc1-6398111473fb" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:43 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-816d403a-0c01-4c11-ac9e-3911977e54b8 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-d7b5de69-0df8-4e5a-8bc1-6398111473fb" acquired by "delete_volume" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:43 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-51442488-81a8-4738-9472-694721da7a87 req-fb62d3b5-ce5e-44ec-bf6f-13cb5d481007 tempest-TestStampPattern-1991106930 None] attachment_update completed successfully. Apr 29 17:31:43 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e32fb6-30ad-4c75-ab85-f207c4948986]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-816d403a-0c01-4c11-ac9e-3911977e54b8 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d7b5de69-0df8-4e5a-8bc1-6398111473fb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:44 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d7b5de69-0df8-4e5a-8bc1-6398111473fb Apr 29 17:31:44 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:44 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-816d403a-0c01-4c11-ac9e-3911977e54b8 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d7b5de69-0df8-4e5a-8bc1-6398111473fb" returned: 0 in 0.957s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-816d403a-0c01-4c11-ac9e-3911977e54b8 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d7b5de69-0df8-4e5a-8bc1-6398111473fb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:44 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d7b5de69-0df8-4e5a-8bc1-6398111473fb Apr 29 17:31:44 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:45 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-816d403a-0c01-4c11-ac9e-3911977e54b8 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d7b5de69-0df8-4e5a-8bc1-6398111473fb" returned: 0 in 0.760s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:45 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-816d403a-0c01-4c11-ac9e-3911977e54b8 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-d7b5de69-0df8-4e5a-8bc1-6398111473fb" released by "delete_volume" :: held 1.776s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:45 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-816d403a-0c01-4c11-ac9e-3911977e54b8 tempest-VolumesSnapshotTestJSON-532061065 None] Created reservations ['9e12dec9-789f-4a89-8ea3-0cd27b9efb6b', 'd5dca69f-34df-4dea-9b67-1eb4a07259fc', 'f204608a-6703-472c-b45d-360a11069580', '83e17c64-5634-477a-baeb-5f0ed429269f'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:31:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-816d403a-0c01-4c11-ac9e-3911977e54b8 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-816d403a-0c01-4c11-ac9e-3911977e54b8 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-816d403a-0c01-4c11-ac9e-3911977e54b8 tempest-VolumesSnapshotTestJSON-532061065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:31:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-816d403a-0c01-4c11-ac9e-3911977e54b8 tempest-VolumesSnapshotTestJSON-532061065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:31:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-816d403a-0c01-4c11-ac9e-3911977e54b8 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-816d403a-0c01-4c11-ac9e-3911977e54b8 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:45 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:31:45 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-c571e879-88d2-4f04-ba9a-36ed53daa29e-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-c571e879-88d2-4f04-ba9a-36ed53daa29e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-quobyte-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-quobyte-c571e879-88d2-4f04-ba9a-36ed53daa29e" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-c571e879-88d2-4f04-ba9a-36ed53daa29e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] Deleting offline snapshot c571e879-88d2-4f04-ba9a-36ed53daa29e of volume c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:31:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] snapshot_file for this snap is: volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:31:46 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca15287-a5c7-43c1-bce6-ac58e91fd7a6]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:46 devstack sudo[108572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e Apr 29 17:31:46 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:46 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-816d403a-0c01-4c11-ac9e-3911977e54b8 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.688s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:46 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-816d403a-0c01-4c11-ac9e-3911977e54b8 tempest-VolumesSnapshotTestJSON-532061065 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:31:46 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-816d403a-0c01-4c11-ac9e-3911977e54b8 tempest-VolumesSnapshotTestJSON-532061065 None] Deleted volume successfully. Apr 29 17:31:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-816d403a-0c01-4c11-ac9e-3911977e54b8 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-d7b5de69-0df8-4e5a-8bc1-6398111473fb-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:47 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e" returned: 0 in 0.869s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:31:47 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcecb89f-fa60-42cb-8c88-0da26c5cf507]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:47 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 Apr 29 17:31:47 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:48 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59" returned: 0 in 0.938s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:48 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e Apr 29 17:31:48 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:49 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e" returned: 0 in 0.941s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:49 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e Apr 29 17:31:49 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:49 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59.c571e879-88d2-4f04-ba9a-36ed53daa29e" returned: 0 in 0.867s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:49 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-c571e879-88d2-4f04-ba9a-36ed53daa29e" released by "_delete_snapshot" :: held 3.774s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:49 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59" released by "delete_snapshot" :: held 3.812s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:50 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] Created reservations ['20fe3b15-b295-48c8-9864-8338d18d2554', '1d83a4c3-0a45-4dc1-b3f1-6bee316b7913', '79fef5a6-4675-414e-8d35-4bd9ec97bdff', 'e23f75b7-a457-4002-86bf-ae658a6d20e5'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:31:50 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] Delete snapshot completed successfully. Apr 29 17:31:50 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d51c04e8-3458-4b07-8c0d-d142b7ef9bc0 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-c571e879-88d2-4f04-ba9a-36ed53daa29e-delete_snapshot" released by "delete_snapshot" :: held 4.008s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:50 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-efbdbb55-b3d9-458c-af89-8046224c174f tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:50 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-efbdbb55-b3d9-458c-af89-8046224c174f tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:50 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-efbdbb55-b3d9-458c-af89-8046224c174f tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-quobyte-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:50 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-efbdbb55-b3d9-458c-af89-8046224c174f tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59" acquired by "delete_volume" :: waited 0.025s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:50 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[7390f90e-e122-4a79-944a-693f80f211f3]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-efbdbb55-b3d9-458c-af89-8046224c174f tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:50 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 Apr 29 17:31:50 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:51 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-6cdb90c1-d50a-4f5d-a5af-62713da2c2d7 req-4ebe05de-fc42-4a82-9771-d6d26959a221 tempest-TestStampPattern-1991106930 None] Terminate volume connection completed successfully. Apr 29 17:31:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-6cdb90c1-d50a-4f5d-a5af-62713da2c2d7 req-4ebe05de-fc42-4a82-9771-d6d26959a221 tempest-TestStampPattern-1991106930 None] Deleting attachment 055f9b2a-3849-44ef-a71d-badd3e961897. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:31:51 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-efbdbb55-b3d9-458c-af89-8046224c174f tempest-VolumesSnapshotTestJSON-532061065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59" returned: 0 in 0.927s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-efbdbb55-b3d9-458c-af89-8046224c174f tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:51 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59 Apr 29 17:31:51 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:52 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-efbdbb55-b3d9-458c-af89-8046224c174f tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59" returned: 0 in 0.614s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-efbdbb55-b3d9-458c-af89-8046224c174f tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59" released by "delete_volume" :: held 1.613s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:52 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-efbdbb55-b3d9-458c-af89-8046224c174f tempest-VolumesSnapshotTestJSON-532061065 None] Created reservations ['9f08428e-6679-4b68-84f5-bab401f902f9', '834a8bb3-388c-4bfe-8650-4e8546d0c9e0', '52170aad-ea1d-49db-9282-8844313ffa05', '4d691f26-1481-41df-a773-9c38734b76c5'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:31:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-efbdbb55-b3d9-458c-af89-8046224c174f tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-efbdbb55-b3d9-458c-af89-8046224c174f tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-efbdbb55-b3d9-458c-af89-8046224c174f tempest-VolumesSnapshotTestJSON-532061065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:31:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-efbdbb55-b3d9-458c-af89-8046224c174f tempest-VolumesSnapshotTestJSON-532061065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:31:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-efbdbb55-b3d9-458c-af89-8046224c174f tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-efbdbb55-b3d9-458c-af89-8046224c174f tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:52 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:31:52 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:52 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-efbdbb55-b3d9-458c-af89-8046224c174f tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.630s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:52 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-efbdbb55-b3d9-458c-af89-8046224c174f tempest-VolumesSnapshotTestJSON-532061065 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:31:52 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-efbdbb55-b3d9-458c-af89-8046224c174f tempest-VolumesSnapshotTestJSON-532061065 None] Deleted volume successfully. Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-efbdbb55-b3d9-458c-af89-8046224c174f tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-c7e79a49-e3f0-4bf0-85e2-c2e2b63b1f59-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Flow 'volume_create_manager' (c8441b5b-cf54-48f9-aef1-692e6f93983b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394e6192-c1f5-4fbd-a55d-13f8e2a30d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394e6192-c1f5-4fbd-a55d-13f8e2a30d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1071570321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d034bf97-68f1-4475-982c-ab42fba85f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77efeec60544d47bdcf52e70ae40517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:31:53Z,use_quota=True,user_id='ba9bb61d783e468dbc781aa7ca9c8213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b962b5e3-307b-4144-866a-7efd049de2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b962b5e3-307b-4144-866a-7efd049de2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a805e1fc-cd43-4bd9-9e0d-8d88814d6612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a805e1fc-cd43-4bd9-9e0d-8d88814d6612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd034bf97-68f1-4475-982c-ab42fba85f60', 'volume_name': 'volume-d034bf97-68f1-4475-982c-ab42fba85f60', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b781b04b-3e6b-4ca0-9a3c-74e4e422fd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b781b04b-3e6b-4ca0-9a3c-74e4e422fd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cf672a-5221-4daa-a5ab-08c8eeed2b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:53 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Volume d034bf97-68f1-4475-982c-ab42fba85f60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d034bf97-68f1-4475-982c-ab42fba85f60', 'volume_size': 1} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1071570321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d034bf97-68f1-4475-982c-ab42fba85f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77efeec60544d47bdcf52e70ae40517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:31:53Z,use_quota=True,user_id='ba9bb61d783e468dbc781aa7ca9c8213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Creating volume d034bf97-68f1-4475-982c-ab42fba85f60 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:31:53 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:53 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 1073741824 Apr 29 17:31:53 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Flow 'volume_create_manager' (1f712d38-5b43-46ef-8271-5db2ec270f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145201d0-4eed-4db6-bf31-bc41f619c9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145201d0-4eed-4db6-bf31-bc41f619c9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2006258689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f7dc35-1d7e-4760-815d-4a63524fe084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f48ed9e0e14b0fa59aaa2e6e1d1488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:31:53Z,use_quota=True,user_id='511124bcc3ba47218fab0af81f0785ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c649fe01-c8dc-4c14-ac71-2e9114046fd6),volume_type_id=c649fe01-c8dc-4c14-ac71-2e9114046fd6)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (352ccc40-1609-4954-8229-9913048346c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (352ccc40-1609-4954-8229-9913048346c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86cbf7c1-2cbf-49cd-8381-561571f87e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86cbf7c1-2cbf-49cd-8381-561571f87e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74f7dc35-1d7e-4760-815d-4a63524fe084', 'volume_name': 'volume-74f7dc35-1d7e-4760-815d-4a63524fe084', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df945182-6eef-494f-ae47-23dbd5e18d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df945182-6eef-494f-ae47-23dbd5e18d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68538572-7a82-4cd8-b7ce-64a246fd9bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:53 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Volume 74f7dc35-1d7e-4760-815d-4a63524fe084: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74f7dc35-1d7e-4760-815d-4a63524fe084', 'volume_size': 1} Apr 29 17:31:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:54 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 1073741824" returned: 0 in 0.923s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:54 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 Apr 29 17:31:54 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:54 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60" returned: 0 in 0.623s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:31:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.361s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2006258689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74f7dc35-1d7e-4760-815d-4a63524fe084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f48ed9e0e14b0fa59aaa2e6e1d1488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:31:53Z,use_quota=True,user_id='511124bcc3ba47218fab0af81f0785ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c649fe01-c8dc-4c14-ac71-2e9114046fd6),volume_type_id=c649fe01-c8dc-4c14-ac71-2e9114046fd6)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:31:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Creating volume 74f7dc35-1d7e-4760-815d-4a63524fe084 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:31:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:31:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:31:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:31:54 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:31:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74f7dc35-1d7e-4760-815d-4a63524fe084 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:54 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74f7dc35-1d7e-4760-815d-4a63524fe084 1073741824 Apr 29 17:31:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cf672a-5221-4daa-a5ab-08c8eeed2b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d034bf97-68f1-4475-982c-ab42fba85f60', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:54 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99c01ad-78d9-4891-99b2-44598b8ab57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:54 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Volume volume-d034bf97-68f1-4475-982c-ab42fba85f60 (d034bf97-68f1-4475-982c-ab42fba85f60): created successfully Apr 29 17:31:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99c01ad-78d9-4891-99b2-44598b8ab57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Flow 'volume_create_manager' (c8441b5b-cf54-48f9-aef1-692e6f93983b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:31:54 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-a508a44b-7ea0-49d4-87b0-61ff8fa6949b tempest-VolumesSnapshotTestJSON-532061065 None] Created volume successfully. Apr 29 17:31:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-40d17f45-c655-4011-8154-f04dcf804c77 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:56 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74f7dc35-1d7e-4760-815d-4a63524fe084 1073741824" returned: 0 in 1.087s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74f7dc35-1d7e-4760-815d-4a63524fe084 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:56 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74f7dc35-1d7e-4760-815d-4a63524fe084 Apr 29 17:31:56 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:56 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74f7dc35-1d7e-4760-815d-4a63524fe084" returned: 0 in 0.635s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:31:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-40d17f45-c655-4011-8154-f04dcf804c77 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.888s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-40d17f45-c655-4011-8154-f04dcf804c77 tempest-VolumesSnapshotTestJSON-532061065 None] Creating offline snapshot 17c4b2c4-b1c3-480f-99e9-7e3343340a35 of volume d034bf97-68f1-4475-982c-ab42fba85f60 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:31:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68538572-7a82-4cd8-b7ce-64a246fd9bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74f7dc35-1d7e-4760-815d-4a63524fe084', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb19c5b4-f08e-49d2-a2be-f1c5e9a02b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:31:56 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a091e14-8209-4d48-9191-36e12f062829]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-40d17f45-c655-4011-8154-f04dcf804c77 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:56 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Volume volume-74f7dc35-1d7e-4760-815d-4a63524fe084 (74f7dc35-1d7e-4760-815d-4a63524fe084): created successfully Apr 29 17:31:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb19c5b4-f08e-49d2-a2be-f1c5e9a02b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:31:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Flow 'volume_create_manager' (1f712d38-5b43-46ef-8271-5db2ec270f97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:31:56 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-b059e513-756c-4891-bce0-16ccce559851 tempest-VolumeTypesAccessTest-2036480893 None] Created volume successfully. Apr 29 17:31:56 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 Apr 29 17:31:56 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:57 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-40d17f45-c655-4011-8154-f04dcf804c77 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60" returned: 0 in 0.723s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-40d17f45-c655-4011-8154-f04dcf804c77 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:57 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35 1G Apr 29 17:31:57 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] Acquiring lock "cinder-74f7dc35-1d7e-4760-815d-4a63524fe084-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] Lock "cinder-74f7dc35-1d7e-4760-815d-4a63524fe084-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] Acquiring lock "cinder-quobyte-74f7dc35-1d7e-4760-815d-4a63524fe084" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:31:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] Lock "cinder-quobyte-74f7dc35-1d7e-4760-815d-4a63524fe084" acquired by "delete_volume" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:31:57 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[e535d0b5-cdff-414a-b7e8-cf4c054a4890]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:31:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74f7dc35-1d7e-4760-815d-4a63524fe084 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:57 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74f7dc35-1d7e-4760-815d-4a63524fe084 Apr 29 17:31:57 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:58 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-40d17f45-c655-4011-8154-f04dcf804c77 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35 1G" returned: 0 in 0.772s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-40d17f45-c655-4011-8154-f04dcf804c77 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d034bf97-68f1-4475-982c-ab42fba85f60 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:58 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d034bf97-68f1-4475-982c-ab42fba85f60 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35 Apr 29 17:31:58 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:58 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74f7dc35-1d7e-4760-815d-4a63524fe084" returned: 0 in 0.726s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74f7dc35-1d7e-4760-815d-4a63524fe084 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:58 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74f7dc35-1d7e-4760-815d-4a63524fe084 Apr 29 17:31:58 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:58 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-40d17f45-c655-4011-8154-f04dcf804c77 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d034bf97-68f1-4475-982c-ab42fba85f60 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35" returned: 0 in 0.666s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:58 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-40d17f45-c655-4011-8154-f04dcf804c77 tempest-VolumesSnapshotTestJSON-532061065 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35 is being set with open permissions: ugo+rw Apr 29 17:31:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-40d17f45-c655-4011-8154-f04dcf804c77 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:58 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35 Apr 29 17:31:58 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:59 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74f7dc35-1d7e-4760-815d-4a63524fe084" returned: 0 in 0.632s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] Lock "cinder-quobyte-74f7dc35-1d7e-4760-815d-4a63524fe084" released by "delete_volume" :: held 1.419s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:31:59 devstack cinder-volume[84547]: WARNING cinder.quota [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1187435389 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1187435389, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:31:59 devstack cinder-volume[84547]: WARNING cinder.quota [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1187435389 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1187435389, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:31:59 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] Created reservations ['d278b44f-f086-4d94-9057-892e4f8aacc8', '9d48f394-7465-40bd-ad31-ebc3909e4038', 'ac9b802b-df31-4d3c-81a4-b25cd95fa7bd', 'b4ecb651-dab9-4c6e-87fa-46f8cbb9ad8c'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:31:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:31:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:31:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:31:59 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:31:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:31:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:59 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:31:59 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:59 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-40d17f45-c655-4011-8154-f04dcf804c77 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35" returned: 0 in 0.616s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-40d17f45-c655-4011-8154-f04dcf804c77 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:31:59 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.info Apr 29 17:31:59 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:31:59 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Apr 29 17:31:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.619s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:31:59 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:31:59 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] Deleted volume successfully. Apr 29 17:32:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4f14af27-a948-4804-b7ea-ca8b51e7e90e tempest-VolumeTypesAccessTest-2036480893 None] Lock "cinder-74f7dc35-1d7e-4760-815d-4a63524fe084-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:00 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-40d17f45-c655-4011-8154-f04dcf804c77 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.info" returned: 0 in 0.625s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:00 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-40d17f45-c655-4011-8154-f04dcf804c77 tempest-VolumesSnapshotTestJSON-532061065 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.info is being set with open permissions: ugo+rw Apr 29 17:32:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-40d17f45-c655-4011-8154-f04dcf804c77 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:00 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.info Apr 29 17:32:00 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ddc0dc3c-94e3-488d-8640-97eff09db281 tempest-TestStampPattern-1991106930 None] Acquiring lock "cinder-fa17f3d2-ebac-4d5a-938c-9f5a3a120798-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ddc0dc3c-94e3-488d-8640-97eff09db281 tempest-TestStampPattern-1991106930 None] Lock "cinder-fa17f3d2-ebac-4d5a-938c-9f5a3a120798-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ddc0dc3c-94e3-488d-8640-97eff09db281 tempest-TestStampPattern-1991106930 None] Acquiring lock "cinder-quobyte-fa17f3d2-ebac-4d5a-938c-9f5a3a120798" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ddc0dc3c-94e3-488d-8640-97eff09db281 tempest-TestStampPattern-1991106930 None] Lock "cinder-quobyte-fa17f3d2-ebac-4d5a-938c-9f5a3a120798" acquired by "delete_volume" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:00 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f29cd1-9612-4843-8391-129866b7b1a1]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ddc0dc3c-94e3-488d-8640-97eff09db281 tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:00 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-40d17f45-c655-4011-8154-f04dcf804c77 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.info" returned: 0 in 0.637s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-40d17f45-c655-4011-8154-f04dcf804c77 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.147s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:00 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-40d17f45-c655-4011-8154-f04dcf804c77 tempest-VolumesSnapshotTestJSON-532061065 None] Create snapshot completed successfully Apr 29 17:32:00 devstack sudo[108743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798 Apr 29 17:32:00 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:01 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ddc0dc3c-94e3-488d-8640-97eff09db281 tempest-TestStampPattern-1991106930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798" returned: 0 in 0.809s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ddc0dc3c-94e3-488d-8640-97eff09db281 tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:01 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798 Apr 29 17:32:01 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Flow 'volume_create_manager' (97ca7446-69e2-419e-8897-8015cea86f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b672a831-31c7-412a-a6da-e389507b8940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b672a831-31c7-412a-a6da-e389507b8940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-19276163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da9920f5-ae53-4709-8903-78ee873d7374,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a77efeec60544d47bdcf52e70ae40517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=17c4b2c4-b1c3-480f-99e9-7e3343340a35,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:32:02Z,use_quota=True,user_id='ba9bb61d783e468dbc781aa7ca9c8213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0897b14d-0516-4792-a11d-00f3b3399a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0897b14d-0516-4792-a11d-00f3b3399a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14bbd1b-b0cf-4705-858f-b302008babed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e14bbd1b-b0cf-4705-858f-b302008babed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'da9920f5-ae53-4709-8903-78ee873d7374', 'volume_name': 'volume-da9920f5-ae53-4709-8903-78ee873d7374', 'volume_size': 1, 'snapshot_id': '17c4b2c4-b1c3-480f-99e9-7e3343340a35'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a04d66-e725-4799-911d-bb5bba3e05da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0a04d66-e725-4799-911d-bb5bba3e05da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0077ad-bbef-4bb7-b088-84ceaec66ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:01 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Volume da9920f5-ae53-4709-8903-78ee873d7374: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-da9920f5-ae53-4709-8903-78ee873d7374', 'volume_size': 1, 'snapshot_id': '17c4b2c4-b1c3-480f-99e9-7e3343340a35'} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-quobyte-17c4b2c4-b1c3-480f-99e9-7e3343340a35-da9920f5-ae53-4709-8903-78ee873d7374" by "_create_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-17c4b2c4-b1c3-480f-99e9-7e3343340a35-da9920f5-ae53-4709-8903-78ee873d7374" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Creating volume da9920f5-ae53-4709-8903-78ee873d7374 from snapshot 17c4b2c4-b1c3-480f-99e9-7e3343340a35 {{(pid=84547) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-quobyte-da9920f5-ae53-4709-8903-78ee873d7374" by "_copy_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-da9920f5-ae53-4709-8903-78ee873d7374" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] snapshot: 17c4b2c4-b1c3-480f-99e9-7e3343340a35, volume: da9920f5-ae53-4709-8903-78ee873d7374, {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 17:32:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:32:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:32:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:02 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e69ff6-da4f-4ecc-aa00-68ccd939ec8c]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:02 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35 Apr 29 17:32:02 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:02 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ddc0dc3c-94e3-488d-8640-97eff09db281 tempest-TestStampPattern-1991106930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fa17f3d2-ebac-4d5a-938c-9f5a3a120798" returned: 0 in 0.738s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ddc0dc3c-94e3-488d-8640-97eff09db281 tempest-TestStampPattern-1991106930 None] Lock "cinder-quobyte-fa17f3d2-ebac-4d5a-938c-9f5a3a120798" released by "delete_volume" :: held 1.600s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:02 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-ddc0dc3c-94e3-488d-8640-97eff09db281 tempest-TestStampPattern-1991106930 None] Created reservations ['1f4a9c4a-d08f-41d3-9e49-7e94fa873409', 'ed543472-a523-423f-9617-cdfcfe378f12', 'b79b9678-e339-4ae8-a498-ae3bda6301a7', '7df1277b-578f-430b-be7b-ffc0b31cdf85'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:32:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ddc0dc3c-94e3-488d-8640-97eff09db281 tempest-TestStampPattern-1991106930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ddc0dc3c-94e3-488d-8640-97eff09db281 tempest-TestStampPattern-1991106930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ddc0dc3c-94e3-488d-8640-97eff09db281 tempest-TestStampPattern-1991106930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:32:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ddc0dc3c-94e3-488d-8640-97eff09db281 tempest-TestStampPattern-1991106930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:32:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ddc0dc3c-94e3-488d-8640-97eff09db281 tempest-TestStampPattern-1991106930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ddc0dc3c-94e3-488d-8640-97eff09db281 tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:02 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:32:02 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:03 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35" returned: 0 in 0.957s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d034bf97-68f1-4475-982c-ab42fba85f60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:32:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 17:32:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Creating direct copy from snapshot {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 17:32:03 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff47e0d-57db-4b15-986e-5ef8dd89b453]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:03 devstack sudo[108766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 Apr 29 17:32:03 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:03 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ddc0dc3c-94e3-488d-8640-97eff09db281 tempest-TestStampPattern-1991106930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.947s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:03 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-ddc0dc3c-94e3-488d-8640-97eff09db281 tempest-TestStampPattern-1991106930 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:32:03 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ddc0dc3c-94e3-488d-8640-97eff09db281 tempest-TestStampPattern-1991106930 None] Deleted volume successfully. Apr 29 17:32:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] Acquiring lock "cinder-1fc85c24-c9bd-4dab-96b4-273a94ef23d8-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] Lock "cinder-1fc85c24-c9bd-4dab-96b4-273a94ef23d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] Acquiring lock "cinder-quobyte-4bd3193e-fb20-4262-bb8d-686960ab3308" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ddc0dc3c-94e3-488d-8640-97eff09db281 tempest-TestStampPattern-1991106930 None] Lock "cinder-fa17f3d2-ebac-4d5a-938c-9f5a3a120798-delete_volume" released by "delete_volume" :: held 2.869s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] Lock "cinder-quobyte-4bd3193e-fb20-4262-bb8d-686960ab3308" acquired by "delete_snapshot" :: waited 0.041s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] Acquiring lock "cinder-quobyte-1fc85c24-c9bd-4dab-96b4-273a94ef23d8" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] Lock "cinder-quobyte-1fc85c24-c9bd-4dab-96b4-273a94ef23d8" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] Deleting offline snapshot 1fc85c24-c9bd-4dab-96b4-273a94ef23d8 of volume 4bd3193e-fb20-4262-bb8d-686960ab3308 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:32:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] snapshot_file for this snap is: volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:32:03 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[168ffab3-99b0-4a72-a842-d03d4f6b8dbf]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:03 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8 Apr 29 17:32:03 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:04 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60" returned: 0 in 1.005s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:04 devstack cinder-volume[84547]: DEBUG cinder.utils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Path /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-da9920f5-ae53-4709-8903-78ee873d7374 not found in is_blk_device check {{(pid=84547) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 17:32:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-da9920f5-ae53-4709-8903-78ee873d7374 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:04 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-da9920f5-ae53-4709-8903-78ee873d7374 Apr 29 17:32:04 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:04 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8" returned: 0 in 1.005s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:04 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bd3193e-fb20-4262-bb8d-686960ab3308(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:32:04 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f79c59-2698-467e-a631-ef2f1bd3984a]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:04 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 Apr 29 17:32:04 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:32:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:32:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:32:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:05 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:32:05 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:06 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308" returned: 0 in 1.386s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:06 devstack sudo[108837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8 Apr 29 17:32:06 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:07 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.430s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:07 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:32:08 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8" returned: 0 in 2.134s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:08 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8 Apr 29 17:32:08 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:09 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308.1fc85c24-c9bd-4dab-96b4-273a94ef23d8" returned: 0 in 1.029s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:09 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] Lock "cinder-quobyte-1fc85c24-c9bd-4dab-96b4-273a94ef23d8" released by "_delete_snapshot" :: held 5.768s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:09 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] Lock "cinder-quobyte-4bd3193e-fb20-4262-bb8d-686960ab3308" released by "delete_snapshot" :: held 5.833s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:09 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] Created reservations ['13d11ff5-f89b-42d1-85a8-dc42217f89b7', '7a40af9f-b3b2-4874-805c-5446084169fe', 'fd69f346-6eec-4b2c-8cb9-1f745e8177ef', '2cf166bb-2944-4a0a-8709-4da6cc9046f2'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:32:09 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] Delete snapshot completed successfully. Apr 29 17:32:09 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-14bff97c-46ed-4321-bb39-3f05ebfd16be tempest-TestStampPattern-1991106930 None] Lock "cinder-1fc85c24-c9bd-4dab-96b4-273a94ef23d8-delete_snapshot" released by "delete_snapshot" :: held 6.245s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:10 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-da9920f5-ae53-4709-8903-78ee873d7374" returned: 0 in 6.264s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:10 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[641ca2c1-fe97-499d-8c79-848f8bd667b3]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:10 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 Apr 29 17:32:10 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:11 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60" returned: 0 in 1.065s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:11 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60, size 1024.00 MB, duration 6.27 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-da9920f5-ae53-4709-8903-78ee873d7374 {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:32:11 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Converted 1024.00 MB image at 163.44 MB/s Apr 29 17:32:11 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-da9920f5-ae53-4709-8903-78ee873d7374 is being set with open permissions: ugo+rw Apr 29 17:32:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-da9920f5-ae53-4709-8903-78ee873d7374 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:11 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-da9920f5-ae53-4709-8903-78ee873d7374 Apr 29 17:32:11 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:12 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-da9920f5-ae53-4709-8903-78ee873d7374" returned: 0 in 0.638s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-da9920f5-ae53-4709-8903-78ee873d7374" released by "_copy_volume_from_snapshot" :: held 10.070s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-17c4b2c4-b1c3-480f-99e9-7e3343340a35-da9920f5-ae53-4709-8903-78ee873d7374" released by "_create_volume_from_snapshot" :: held 10.123s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.144s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c0077ad-bbef-4bb7-b088-84ceaec66ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da9920f5-ae53-4709-8903-78ee873d7374', 'volume_size': 1, 'snapshot_id': '17c4b2c4-b1c3-480f-99e9-7e3343340a35'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c429e7b-8763-458c-850c-5d3d52ab7f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:12 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Volume volume-da9920f5-ae53-4709-8903-78ee873d7374 (da9920f5-ae53-4709-8903-78ee873d7374): created successfully Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c429e7b-8763-458c-850c-5d3d52ab7f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Flow 'volume_create_manager' (97ca7446-69e2-419e-8897-8015cea86f35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:32:12 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-06e0b126-11f4-4375-a8b7-e7770f2a2a59 tempest-VolumesSnapshotTestJSON-532061065 None] Created volume successfully. Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Flow 'volume_create_manager' (ead50d6f-7645-43fc-859a-9881b402fc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f9ffa7-7dff-4abe-8463-98b9a59ba4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f9ffa7-7dff-4abe-8463-98b9a59ba4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1581638475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6a25b8-9582-4c26-b0f3-714507672a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3fe6b18d6640a08d7c474558737927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:32:12Z,use_quota=True,user_id='769c15d84c7f4be8b4f96593445deb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa5b411-92fc-4fd2-a903-ca1f0d433f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa5b411-92fc-4fd2-a903-ca1f0d433f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ae90ab-df58-4fc2-a9ee-f0398c466cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ae90ab-df58-4fc2-a9ee-f0398c466cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a6a25b8-9582-4c26-b0f3-714507672a03', 'volume_name': 'volume-5a6a25b8-9582-4c26-b0f3-714507672a03', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (883abbc3-8def-4dea-b8c9-569a7175c317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (883abbc3-8def-4dea-b8c9-569a7175c317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94086c0f-4226-4a87-af7e-87d8f99ab790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:12 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Volume 5a6a25b8-9582-4c26-b0f3-714507672a03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a6a25b8-9582-4c26-b0f3-714507672a03', 'volume_size': 1} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1581638475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a6a25b8-9582-4c26-b0f3-714507672a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3fe6b18d6640a08d7c474558737927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:32:12Z,use_quota=True,user_id='769c15d84c7f4be8b4f96593445deb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Creating volume 5a6a25b8-9582-4c26-b0f3-714507672a03 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:32:12 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:12 devstack sudo[108901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 1073741824 Apr 29 17:32:12 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-830a80a9-26f3-4e46-9769-9a0ad8fb5ff3 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-da9920f5-ae53-4709-8903-78ee873d7374-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:12 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-830a80a9-26f3-4e46-9769-9a0ad8fb5ff3 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-da9920f5-ae53-4709-8903-78ee873d7374-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:13 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-830a80a9-26f3-4e46-9769-9a0ad8fb5ff3 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-quobyte-da9920f5-ae53-4709-8903-78ee873d7374" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:13 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-830a80a9-26f3-4e46-9769-9a0ad8fb5ff3 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-da9920f5-ae53-4709-8903-78ee873d7374" acquired by "delete_volume" :: waited 0.026s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:13 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[035389c1-b55e-4f47-8c24-cf89c4231952]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-830a80a9-26f3-4e46-9769-9a0ad8fb5ff3 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-da9920f5-ae53-4709-8903-78ee873d7374 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:13 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-da9920f5-ae53-4709-8903-78ee873d7374 Apr 29 17:32:13 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:13 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 1073741824" returned: 0 in 0.971s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:13 devstack sudo[108912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 Apr 29 17:32:13 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:13 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-830a80a9-26f3-4e46-9769-9a0ad8fb5ff3 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-da9920f5-ae53-4709-8903-78ee873d7374" returned: 0 in 0.822s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-830a80a9-26f3-4e46-9769-9a0ad8fb5ff3 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-da9920f5-ae53-4709-8903-78ee873d7374 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:14 devstack sudo[108917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-da9920f5-ae53-4709-8903-78ee873d7374 Apr 29 17:32:14 devstack sudo[108917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:14 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03" returned: 0 in 0.733s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:32:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94086c0f-4226-4a87-af7e-87d8f99ab790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a6a25b8-9582-4c26-b0f3-714507672a03', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa546a8-78f7-44af-b67d-41b80387d4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:14 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Volume volume-5a6a25b8-9582-4c26-b0f3-714507672a03 (5a6a25b8-9582-4c26-b0f3-714507672a03): created successfully Apr 29 17:32:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa546a8-78f7-44af-b67d-41b80387d4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Flow 'volume_create_manager' (ead50d6f-7645-43fc-859a-9881b402fc3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:32:14 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d709dff7-f394-4cf5-85ec-391941ed5471 tempest-VolumesCloneTest-333403705 None] Created volume successfully. Apr 29 17:32:14 devstack sudo[108917]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-830a80a9-26f3-4e46-9769-9a0ad8fb5ff3 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-da9920f5-ae53-4709-8903-78ee873d7374" returned: 0 in 0.671s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:14 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-830a80a9-26f3-4e46-9769-9a0ad8fb5ff3 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-da9920f5-ae53-4709-8903-78ee873d7374" released by "delete_volume" :: held 1.537s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:14 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-830a80a9-26f3-4e46-9769-9a0ad8fb5ff3 tempest-VolumesSnapshotTestJSON-532061065 None] Created reservations ['0b9cc637-4185-44e8-8fd9-d7773ac929bf', '39f2dda0-8669-4001-afa5-4f513c7ff6ef', '12af72a9-fc33-4f2b-9bb8-bf5869411588', '2875a21b-f40b-4ee3-b8b9-a568e5cc37f0'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:32:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-830a80a9-26f3-4e46-9769-9a0ad8fb5ff3 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-830a80a9-26f3-4e46-9769-9a0ad8fb5ff3 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-830a80a9-26f3-4e46-9769-9a0ad8fb5ff3 tempest-VolumesSnapshotTestJSON-532061065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:32:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-830a80a9-26f3-4e46-9769-9a0ad8fb5ff3 tempest-VolumesSnapshotTestJSON-532061065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:32:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-830a80a9-26f3-4e46-9769-9a0ad8fb5ff3 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-830a80a9-26f3-4e46-9769-9a0ad8fb5ff3 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:14 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:32:14 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:15 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-17c4b2c4-b1c3-480f-99e9-7e3343340a35-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:15 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-17c4b2c4-b1c3-480f-99e9-7e3343340a35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:15 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-quobyte-d034bf97-68f1-4475-982c-ab42fba85f60" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:15 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-d034bf97-68f1-4475-982c-ab42fba85f60" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:15 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-quobyte-17c4b2c4-b1c3-480f-99e9-7e3343340a35" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:15 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-17c4b2c4-b1c3-480f-99e9-7e3343340a35" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] Deleting offline snapshot 17c4b2c4-b1c3-480f-99e9-7e3343340a35 of volume d034bf97-68f1-4475-982c-ab42fba85f60 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:32:15 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] snapshot_file for this snap is: volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:32:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-830a80a9-26f3-4e46-9769-9a0ad8fb5ff3 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.610s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:15 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-830a80a9-26f3-4e46-9769-9a0ad8fb5ff3 tempest-VolumesSnapshotTestJSON-532061065 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:32:15 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-830a80a9-26f3-4e46-9769-9a0ad8fb5ff3 tempest-VolumesSnapshotTestJSON-532061065 None] Deleted volume successfully. Apr 29 17:32:15 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[79de3edc-5a12-46e9-becd-8f1fa48c8bbe]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:15 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-830a80a9-26f3-4e46-9769-9a0ad8fb5ff3 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-da9920f5-ae53-4709-8903-78ee873d7374-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:15 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35 Apr 29 17:32:15 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Flow 'volume_create_manager' (a1e10594-c70b-4dde-9df3-53a1acf2dce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e6c9c9-2396-4f36-8ffa-d7a546a89178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e6c9c9-2396-4f36-8ffa-d7a546a89178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-495468584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c672a0ae-01b7-477f-88ae-5d6f776b5130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3fe6b18d6640a08d7c474558737927',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:32:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=5a6a25b8-9582-4c26-b0f3-714507672a03,status='creating',terminated_at=None,updated_at=2026-04-29T15:32:16Z,use_quota=True,user_id='769c15d84c7f4be8b4f96593445deb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:16 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4509aedf-4979-4f35-a0a5-2d7e8354556b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4509aedf-4979-4f35-a0a5-2d7e8354556b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05fa43f-bef9-411b-992a-8e37ef596346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35" returned: 0 in 0.773s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d034bf97-68f1-4475-982c-ab42fba85f60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05fa43f-bef9-411b-992a-8e37ef596346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c672a0ae-01b7-477f-88ae-5d6f776b5130', 'volume_name': 'volume-c672a0ae-01b7-477f-88ae-5d6f776b5130', 'volume_size': 2, 'source_volid': '5a6a25b8-9582-4c26-b0f3-714507672a03', 'source_volstatus': 'available'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd7d9d0-e40b-4467-bc6b-03ff8c79bdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd7d9d0-e40b-4467-bc6b-03ff8c79bdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027952b0-22d5-425c-87a2-3617afe4d01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:16 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Volume c672a0ae-01b7-477f-88ae-5d6f776b5130: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c672a0ae-01b7-477f-88ae-5d6f776b5130', 'volume_size': 2, 'source_volid': '5a6a25b8-9582-4c26-b0f3-714507672a03', 'source_volstatus': 'available'} Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9af6724-c078-4884-a8b3-8c11fccd3b27]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:16 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Cloning volume 5a6a25b8-9582-4c26-b0f3-714507672a03 to volume c672a0ae-01b7-477f-88ae-5d6f776b5130 Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Creating offline snapshot 147f2003-8061-4e7f-a5da-c63cd47eab43 of volume 5a6a25b8-9582-4c26-b0f3-714507672a03 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b814f900-a026-4354-b466-22b90ef47afc]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:16 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 Apr 29 17:32:16 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:16 devstack sudo[108930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 Apr 29 17:32:16 devstack sudo[108930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:16 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60" returned: 0 in 0.748s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:16 devstack sudo[108940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35 Apr 29 17:32:16 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:17 devstack sudo[108930]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03" returned: 0 in 0.760s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:17 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43 1G Apr 29 17:32:17 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2a1cc8f3-6b78-42af-bba5-72f2d5e37652 tempest-TestStampPattern-1991106930 None] Acquiring lock "cinder-4bd3193e-fb20-4262-bb8d-686960ab3308-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2a1cc8f3-6b78-42af-bba5-72f2d5e37652 tempest-TestStampPattern-1991106930 None] Lock "cinder-4bd3193e-fb20-4262-bb8d-686960ab3308-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2a1cc8f3-6b78-42af-bba5-72f2d5e37652 tempest-TestStampPattern-1991106930 None] Acquiring lock "cinder-quobyte-4bd3193e-fb20-4262-bb8d-686960ab3308" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2a1cc8f3-6b78-42af-bba5-72f2d5e37652 tempest-TestStampPattern-1991106930 None] Lock "cinder-quobyte-4bd3193e-fb20-4262-bb8d-686960ab3308" acquired by "delete_volume" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:17 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f60a48-2b35-489b-a8b3-b1becced84ad]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2a1cc8f3-6b78-42af-bba5-72f2d5e37652 tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:17 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35" returned: 0 in 0.763s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:17 devstack sudo[108952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35 Apr 29 17:32:17 devstack sudo[108952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:17 devstack sudo[108951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 Apr 29 17:32:17 devstack sudo[108951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:17 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43 1G" returned: 0 in 0.841s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a6a25b8-9582-4c26-b0f3-714507672a03 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:17 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a6a25b8-9582-4c26-b0f3-714507672a03 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43 Apr 29 17:32:17 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:18 devstack sudo[108952]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60.17c4b2c4-b1c3-480f-99e9-7e3343340a35" returned: 0 in 0.616s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:18 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-17c4b2c4-b1c3-480f-99e9-7e3343340a35" released by "_delete_snapshot" :: held 3.022s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:18 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-d034bf97-68f1-4475-982c-ab42fba85f60" released by "delete_snapshot" :: held 3.046s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:18 devstack sudo[108951]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2a1cc8f3-6b78-42af-bba5-72f2d5e37652 tempest-TestStampPattern-1991106930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308" returned: 0 in 0.764s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2a1cc8f3-6b78-42af-bba5-72f2d5e37652 tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:18 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] Created reservations ['f11f1339-9ba4-44f2-9ac7-eaa3b293cba6', '50691c0b-67e6-40bb-85f3-4b1378587d8c', '5364398e-eb7c-4f8e-86ec-1978e3eaecc5', '96b83d98-a030-4d21-bdc1-cd77d5c39fb2'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:32:18 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308 Apr 29 17:32:18 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:18 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] Delete snapshot completed successfully. Apr 29 17:32:18 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e370b4fa-1252-4d62-aab4-2e1b2789ea9c tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-17c4b2c4-b1c3-480f-99e9-7e3343340a35-delete_snapshot" released by "delete_snapshot" :: held 3.241s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:18 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a6a25b8-9582-4c26-b0f3-714507672a03 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43" returned: 0 in 0.683s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:18 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43 is being set with open permissions: ugo+rw Apr 29 17:32:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:18 devstack sudo[108966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43 Apr 29 17:32:18 devstack sudo[108966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:19 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2a1cc8f3-6b78-42af-bba5-72f2d5e37652 tempest-TestStampPattern-1991106930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4bd3193e-fb20-4262-bb8d-686960ab3308" returned: 0 in 0.608s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2a1cc8f3-6b78-42af-bba5-72f2d5e37652 tempest-TestStampPattern-1991106930 None] Lock "cinder-quobyte-4bd3193e-fb20-4262-bb8d-686960ab3308" released by "delete_volume" :: held 1.438s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-2a1cc8f3-6b78-42af-bba5-72f2d5e37652 tempest-TestStampPattern-1991106930 None] Created reservations ['ff4d93ff-fe8e-4623-926f-539f6cca2b2f', '8451d9c7-1ae5-4f89-ba80-d64c4a75f2d9', '21d176ca-a45a-48fb-96ff-aff0af0c9215', 'cae8bb3b-8345-4008-a4be-29bc4ba497d6'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:32:19 devstack sudo[108966]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43" returned: 0 in 0.620s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2a1cc8f3-6b78-42af-bba5-72f2d5e37652 tempest-TestStampPattern-1991106930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2a1cc8f3-6b78-42af-bba5-72f2d5e37652 tempest-TestStampPattern-1991106930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-2a1cc8f3-6b78-42af-bba5-72f2d5e37652 tempest-TestStampPattern-1991106930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-2a1cc8f3-6b78-42af-bba5-72f2d5e37652 tempest-TestStampPattern-1991106930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2a1cc8f3-6b78-42af-bba5-72f2d5e37652 tempest-TestStampPattern-1991106930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2a1cc8f3-6b78-42af-bba5-72f2d5e37652 tempest-TestStampPattern-1991106930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:19 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:32:19 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:19 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.info Apr 29 17:32:19 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-cb1c51c1-994f-49e8-bb82-aa970707fb33 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-d034bf97-68f1-4475-982c-ab42fba85f60-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-cb1c51c1-994f-49e8-bb82-aa970707fb33 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-d034bf97-68f1-4475-982c-ab42fba85f60-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-cb1c51c1-994f-49e8-bb82-aa970707fb33 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-quobyte-d034bf97-68f1-4475-982c-ab42fba85f60" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-cb1c51c1-994f-49e8-bb82-aa970707fb33 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-d034bf97-68f1-4475-982c-ab42fba85f60" acquired by "delete_volume" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6d6d14-ba72-4dd4-b716-8d2091c483b4]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-cb1c51c1-994f-49e8-bb82-aa970707fb33 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:19 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2a1cc8f3-6b78-42af-bba5-72f2d5e37652 tempest-TestStampPattern-1991106930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.650s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-2a1cc8f3-6b78-42af-bba5-72f2d5e37652 tempest-TestStampPattern-1991106930 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:32:19 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-2a1cc8f3-6b78-42af-bba5-72f2d5e37652 tempest-TestStampPattern-1991106930 None] Deleted volume successfully. Apr 29 17:32:19 devstack sudo[108976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 Apr 29 17:32:19 devstack sudo[108976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:19 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.info" returned: 0 in 0.677s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:19 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.info is being set with open permissions: ugo+rw Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2a1cc8f3-6b78-42af-bba5-72f2d5e37652 tempest-TestStampPattern-1991106930 None] Lock "cinder-4bd3193e-fb20-4262-bb8d-686960ab3308-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:19 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.info Apr 29 17:32:19 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:20 devstack sudo[108976]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-cb1c51c1-994f-49e8-bb82-aa970707fb33 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60" returned: 0 in 0.814s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-cb1c51c1-994f-49e8-bb82-aa970707fb33 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:20 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.info" returned: 0 in 0.689s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:20 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60 Apr 29 17:32:20 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Acquiring lock "cinder-quobyte-c672a0ae-01b7-477f-88ae-5d6f776b5130" by "_copy_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Lock "cinder-quobyte-c672a0ae-01b7-477f-88ae-5d6f776b5130" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:20 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] snapshot: 147f2003-8061-4e7f-a5da-c63cd47eab43, volume: c672a0ae-01b7-477f-88ae-5d6f776b5130, {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 17:32:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:20 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:32:20 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:32:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:20 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b257afc3-9895-4fc7-ae12-0630a5ca3127]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:20 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43 Apr 29 17:32:20 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:21 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-cb1c51c1-994f-49e8-bb82-aa970707fb33 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d034bf97-68f1-4475-982c-ab42fba85f60" returned: 0 in 0.599s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-cb1c51c1-994f-49e8-bb82-aa970707fb33 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-d034bf97-68f1-4475-982c-ab42fba85f60" released by "delete_volume" :: held 1.502s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:21 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-cb1c51c1-994f-49e8-bb82-aa970707fb33 tempest-VolumesSnapshotTestJSON-532061065 None] Created reservations ['20c2badb-aff5-49d0-8310-49c67c343410', 'bcb89e88-1bf3-43dd-8086-0c6f6fc2b0fc', '70e55abc-443a-4828-98dc-dade05b10f55', '42539d2b-4497-4f68-9954-2086ec5a4992'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:32:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-cb1c51c1-994f-49e8-bb82-aa970707fb33 tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-cb1c51c1-994f-49e8-bb82-aa970707fb33 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-cb1c51c1-994f-49e8-bb82-aa970707fb33 tempest-VolumesSnapshotTestJSON-532061065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:32:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-cb1c51c1-994f-49e8-bb82-aa970707fb33 tempest-VolumesSnapshotTestJSON-532061065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:32:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-cb1c51c1-994f-49e8-bb82-aa970707fb33 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-cb1c51c1-994f-49e8-bb82-aa970707fb33 tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:21 devstack sudo[108991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:32:21 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:21 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43" returned: 0 in 0.775s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a6a25b8-9582-4c26-b0f3-714507672a03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:32:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 17:32:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Creating direct copy from snapshot {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 17:32:21 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e3fdf0-5297-448a-af63-593feddc160e]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:21 devstack sudo[108994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 Apr 29 17:32:21 devstack sudo[108994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a44d2b20-d891-4ef7-bbf7-2854b4c7f24d tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-577b2026-7de5-4ead-a86c-8e09e96c4ed2-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:21 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-cb1c51c1-994f-49e8-bb82-aa970707fb33 tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.641s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:21 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-cb1c51c1-994f-49e8-bb82-aa970707fb33 tempest-VolumesSnapshotTestJSON-532061065 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:32:21 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-cb1c51c1-994f-49e8-bb82-aa970707fb33 tempest-VolumesSnapshotTestJSON-532061065 None] Deleted volume successfully. Apr 29 17:32:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a44d2b20-d891-4ef7-bbf7-2854b4c7f24d tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-577b2026-7de5-4ead-a86c-8e09e96c4ed2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-cb1c51c1-994f-49e8-bb82-aa970707fb33 tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-d034bf97-68f1-4475-982c-ab42fba85f60-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a44d2b20-d891-4ef7-bbf7-2854b4c7f24d tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "cinder-quobyte-577b2026-7de5-4ead-a86c-8e09e96c4ed2" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a44d2b20-d891-4ef7-bbf7-2854b4c7f24d tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-577b2026-7de5-4ead-a86c-8e09e96c4ed2" acquired by "delete_volume" :: waited 0.025s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:22 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4031ee-939b-4b31-b330-bbcf2489c8dc]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a44d2b20-d891-4ef7-bbf7-2854b4c7f24d tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:22 devstack sudo[108998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2 Apr 29 17:32:22 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:22 devstack sudo[108994]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03" returned: 0 in 0.785s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:22 devstack cinder-volume[84547]: DEBUG cinder.utils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Path /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c672a0ae-01b7-477f-88ae-5d6f776b5130 not found in is_blk_device check {{(pid=84547) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 17:32:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c672a0ae-01b7-477f-88ae-5d6f776b5130 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:22 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c672a0ae-01b7-477f-88ae-5d6f776b5130 Apr 29 17:32:22 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:22 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a44d2b20-d891-4ef7-bbf7-2854b4c7f24d tempest-VolumesSnapshotTestJSON-532061065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2" returned: 0 in 0.800s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a44d2b20-d891-4ef7-bbf7-2854b4c7f24d tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:22 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2 Apr 29 17:32:22 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:24 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a44d2b20-d891-4ef7-bbf7-2854b4c7f24d tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-577b2026-7de5-4ead-a86c-8e09e96c4ed2" returned: 0 in 1.185s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:24 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a44d2b20-d891-4ef7-bbf7-2854b4c7f24d tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-quobyte-577b2026-7de5-4ead-a86c-8e09e96c4ed2" released by "delete_volume" :: held 2.083s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:24 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-a44d2b20-d891-4ef7-bbf7-2854b4c7f24d tempest-VolumesSnapshotTestJSON-532061065 None] Created reservations ['78dc14fb-f067-4b9a-b1fc-fc8903a85629', 'f2ac8683-1765-4d8f-9191-f4df0d209eeb', '0c8d3a86-458d-48e6-84c1-b86db476c81d', '4838d5fe-cff7-4b0e-9692-2ce88a3e1ec4'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:32:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a44d2b20-d891-4ef7-bbf7-2854b4c7f24d tempest-VolumesSnapshotTestJSON-532061065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a44d2b20-d891-4ef7-bbf7-2854b4c7f24d tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a44d2b20-d891-4ef7-bbf7-2854b4c7f24d tempest-VolumesSnapshotTestJSON-532061065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:32:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a44d2b20-d891-4ef7-bbf7-2854b4c7f24d tempest-VolumesSnapshotTestJSON-532061065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:32:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a44d2b20-d891-4ef7-bbf7-2854b4c7f24d tempest-VolumesSnapshotTestJSON-532061065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a44d2b20-d891-4ef7-bbf7-2854b4c7f24d tempest-VolumesSnapshotTestJSON-532061065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:24 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:32:24 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:26 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a44d2b20-d891-4ef7-bbf7-2854b4c7f24d tempest-VolumesSnapshotTestJSON-532061065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.511s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:26 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-a44d2b20-d891-4ef7-bbf7-2854b4c7f24d tempest-VolumesSnapshotTestJSON-532061065 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:32:26 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-a44d2b20-d891-4ef7-bbf7-2854b4c7f24d tempest-VolumesSnapshotTestJSON-532061065 None] Deleted volume successfully. Apr 29 17:32:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a44d2b20-d891-4ef7-bbf7-2854b4c7f24d tempest-VolumesSnapshotTestJSON-532061065 None] Lock "cinder-577b2026-7de5-4ead-a86c-8e09e96c4ed2-delete_volume" released by "delete_volume" :: held 4.232s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:28 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c672a0ae-01b7-477f-88ae-5d6f776b5130" returned: 0 in 6.082s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:28 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[7938e152-7f7d-4cd2-8849-f05c7c00b74a]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:28 devstack sudo[109028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 Apr 29 17:32:28 devstack sudo[109028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:29 devstack sudo[109028]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03" returned: 0 in 0.966s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:29 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c672a0ae-01b7-477f-88ae-5d6f776b5130 {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:32:29 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Converted 1024.00 MB image at 168.35 MB/s Apr 29 17:32:29 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c672a0ae-01b7-477f-88ae-5d6f776b5130 is being set with open permissions: ugo+rw Apr 29 17:32:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c672a0ae-01b7-477f-88ae-5d6f776b5130 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:29 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c672a0ae-01b7-477f-88ae-5d6f776b5130 Apr 29 17:32:29 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:29 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c672a0ae-01b7-477f-88ae-5d6f776b5130" returned: 0 in 0.647s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:29 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Lock "cinder-quobyte-c672a0ae-01b7-477f-88ae-5d6f776b5130" released by "_copy_volume_from_snapshot" :: held 9.355s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:29 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:DELETE=15,cinder:UPDATE=128,cinder:SELECT=111,cinder:INSERT=30 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:32:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Acquiring lock "cinder-quobyte-147f2003-8061-4e7f-a5da-c63cd47eab43" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Lock "cinder-quobyte-147f2003-8061-4e7f-a5da-c63cd47eab43" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Deleting offline snapshot 147f2003-8061-4e7f-a5da-c63cd47eab43 of volume 5a6a25b8-9582-4c26-b0f3-714507672a03 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:32:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] snapshot_file for this snap is: volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:32:30 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b587d3f-270b-4b5c-9804-eecc6392cf0b]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:30 devstack sudo[109038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43 Apr 29 17:32:30 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:30 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43" returned: 0 in 0.813s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a6a25b8-9582-4c26-b0f3-714507672a03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:32:30 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae6827b-ce3c-4a85-8e45-c73a772edcbd]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:31 devstack sudo[109044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 Apr 29 17:32:31 devstack sudo[109044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:31 devstack sudo[109044]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03" returned: 0 in 0.874s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:31 devstack sudo[109052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43 Apr 29 17:32:31 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:32 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43" returned: 0 in 0.844s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:32 devstack sudo[109057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43 Apr 29 17:32:32 devstack sudo[109057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:33 devstack sudo[109057]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03.147f2003-8061-4e7f-a5da-c63cd47eab43" returned: 0 in 0.690s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:33 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Lock "cinder-quobyte-147f2003-8061-4e7f-a5da-c63cd47eab43" released by "_delete_snapshot" :: held 3.368s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.226s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027952b0-22d5-425c-87a2-3617afe4d01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c672a0ae-01b7-477f-88ae-5d6f776b5130', 'volume_size': 2, 'source_volid': '5a6a25b8-9582-4c26-b0f3-714507672a03', 'source_volstatus': 'available'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57ab529-0836-49ab-85d5-56e1995b3b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:33 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Volume volume-c672a0ae-01b7-477f-88ae-5d6f776b5130 (c672a0ae-01b7-477f-88ae-5d6f776b5130): created successfully Apr 29 17:32:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b57ab529-0836-49ab-85d5-56e1995b3b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Flow 'volume_create_manager' (a1e10594-c70b-4dde-9df3-53a1acf2dce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:32:33 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e511d264-bff4-4118-9d7a-69794bae2bf5 tempest-VolumesCloneTest-333403705 None] Created volume successfully. Apr 29 17:32:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f5a8bb95-0b9f-4e0d-bc31-44cd52b4e629 tempest-VolumesCloneTest-333403705 None] Acquiring lock "cinder-c672a0ae-01b7-477f-88ae-5d6f776b5130-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f5a8bb95-0b9f-4e0d-bc31-44cd52b4e629 tempest-VolumesCloneTest-333403705 None] Lock "cinder-c672a0ae-01b7-477f-88ae-5d6f776b5130-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f5a8bb95-0b9f-4e0d-bc31-44cd52b4e629 tempest-VolumesCloneTest-333403705 None] Acquiring lock "cinder-quobyte-c672a0ae-01b7-477f-88ae-5d6f776b5130" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f5a8bb95-0b9f-4e0d-bc31-44cd52b4e629 tempest-VolumesCloneTest-333403705 None] Lock "cinder-quobyte-c672a0ae-01b7-477f-88ae-5d6f776b5130" acquired by "delete_volume" :: waited 0.015s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:35 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[052f4b17-d8f4-4c94-b39b-5cf2be228115]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f5a8bb95-0b9f-4e0d-bc31-44cd52b4e629 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c672a0ae-01b7-477f-88ae-5d6f776b5130 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:35 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c672a0ae-01b7-477f-88ae-5d6f776b5130 Apr 29 17:32:35 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:35 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f5a8bb95-0b9f-4e0d-bc31-44cd52b4e629 tempest-VolumesCloneTest-333403705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c672a0ae-01b7-477f-88ae-5d6f776b5130" returned: 0 in 0.716s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f5a8bb95-0b9f-4e0d-bc31-44cd52b4e629 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c672a0ae-01b7-477f-88ae-5d6f776b5130 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:35 devstack sudo[109065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c672a0ae-01b7-477f-88ae-5d6f776b5130 Apr 29 17:32:35 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:36 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f5a8bb95-0b9f-4e0d-bc31-44cd52b4e629 tempest-VolumesCloneTest-333403705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c672a0ae-01b7-477f-88ae-5d6f776b5130" returned: 0 in 0.613s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:36 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f5a8bb95-0b9f-4e0d-bc31-44cd52b4e629 tempest-VolumesCloneTest-333403705 None] Lock "cinder-quobyte-c672a0ae-01b7-477f-88ae-5d6f776b5130" released by "delete_volume" :: held 1.371s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:36 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-f5a8bb95-0b9f-4e0d-bc31-44cd52b4e629 tempest-VolumesCloneTest-333403705 None] Created reservations ['9277e4d7-fa57-495e-9b74-a001b6b24ca3', 'd88b1464-2d16-48fd-81b9-17f2b1a61688', 'f5207444-768a-482b-b3e1-2ae33b34728f', '4a79f51b-2622-45d2-a4a1-975c83b0fc61'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:32:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f5a8bb95-0b9f-4e0d-bc31-44cd52b4e629 tempest-VolumesCloneTest-333403705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f5a8bb95-0b9f-4e0d-bc31-44cd52b4e629 tempest-VolumesCloneTest-333403705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:36 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f5a8bb95-0b9f-4e0d-bc31-44cd52b4e629 tempest-VolumesCloneTest-333403705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:32:36 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f5a8bb95-0b9f-4e0d-bc31-44cd52b4e629 tempest-VolumesCloneTest-333403705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:32:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f5a8bb95-0b9f-4e0d-bc31-44cd52b4e629 tempest-VolumesCloneTest-333403705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f5a8bb95-0b9f-4e0d-bc31-44cd52b4e629 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:36 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:32:36 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:37 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f5a8bb95-0b9f-4e0d-bc31-44cd52b4e629 tempest-VolumesCloneTest-333403705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.591s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:37 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-f5a8bb95-0b9f-4e0d-bc31-44cd52b4e629 tempest-VolumesCloneTest-333403705 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:32:37 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f5a8bb95-0b9f-4e0d-bc31-44cd52b4e629 tempest-VolumesCloneTest-333403705 None] Deleted volume successfully. Apr 29 17:32:37 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f5a8bb95-0b9f-4e0d-bc31-44cd52b4e629 tempest-VolumesCloneTest-333403705 None] Lock "cinder-c672a0ae-01b7-477f-88ae-5d6f776b5130-delete_volume" released by "delete_volume" :: held 2.194s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:37 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-bf1cb8d4-8381-46ff-9975-2f0ae62f40e4 tempest-VolumesCloneTest-333403705 None] Acquiring lock "cinder-5a6a25b8-9582-4c26-b0f3-714507672a03-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:37 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-bf1cb8d4-8381-46ff-9975-2f0ae62f40e4 tempest-VolumesCloneTest-333403705 None] Lock "cinder-5a6a25b8-9582-4c26-b0f3-714507672a03-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:37 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-bf1cb8d4-8381-46ff-9975-2f0ae62f40e4 tempest-VolumesCloneTest-333403705 None] Acquiring lock "cinder-quobyte-5a6a25b8-9582-4c26-b0f3-714507672a03" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:37 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-bf1cb8d4-8381-46ff-9975-2f0ae62f40e4 tempest-VolumesCloneTest-333403705 None] Lock "cinder-quobyte-5a6a25b8-9582-4c26-b0f3-714507672a03" acquired by "delete_volume" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:37 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2ade6a-cb64-4cc0-9cbe-d37c9c08b634]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bf1cb8d4-8381-46ff-9975-2f0ae62f40e4 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:37 devstack sudo[109072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 Apr 29 17:32:37 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:38 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bf1cb8d4-8381-46ff-9975-2f0ae62f40e4 tempest-VolumesCloneTest-333403705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03" returned: 0 in 0.823s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bf1cb8d4-8381-46ff-9975-2f0ae62f40e4 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:38 devstack sudo[109077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03 Apr 29 17:32:38 devstack sudo[109077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:38 devstack sudo[109077]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bf1cb8d4-8381-46ff-9975-2f0ae62f40e4 tempest-VolumesCloneTest-333403705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5a6a25b8-9582-4c26-b0f3-714507672a03" returned: 0 in 0.602s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:38 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-bf1cb8d4-8381-46ff-9975-2f0ae62f40e4 tempest-VolumesCloneTest-333403705 None] Lock "cinder-quobyte-5a6a25b8-9582-4c26-b0f3-714507672a03" released by "delete_volume" :: held 1.490s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:38 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-bf1cb8d4-8381-46ff-9975-2f0ae62f40e4 tempest-VolumesCloneTest-333403705 None] Created reservations ['1d9d6fcc-45b9-4b26-8d9d-8feec23974f7', '4d838791-1c24-4251-b52b-1accf371561b', '76a746a5-65ac-4885-8966-380296a98e45', '28854cc3-e110-46cc-bf57-232d94685d82'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:32:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bf1cb8d4-8381-46ff-9975-2f0ae62f40e4 tempest-VolumesCloneTest-333403705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bf1cb8d4-8381-46ff-9975-2f0ae62f40e4 tempest-VolumesCloneTest-333403705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:38 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-bf1cb8d4-8381-46ff-9975-2f0ae62f40e4 tempest-VolumesCloneTest-333403705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:32:38 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-bf1cb8d4-8381-46ff-9975-2f0ae62f40e4 tempest-VolumesCloneTest-333403705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:32:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bf1cb8d4-8381-46ff-9975-2f0ae62f40e4 tempest-VolumesCloneTest-333403705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bf1cb8d4-8381-46ff-9975-2f0ae62f40e4 tempest-VolumesCloneTest-333403705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:38 devstack sudo[109080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:32:38 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:39 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bf1cb8d4-8381-46ff-9975-2f0ae62f40e4 tempest-VolumesCloneTest-333403705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.630s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:39 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-bf1cb8d4-8381-46ff-9975-2f0ae62f40e4 tempest-VolumesCloneTest-333403705 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:32:39 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-bf1cb8d4-8381-46ff-9975-2f0ae62f40e4 tempest-VolumesCloneTest-333403705 None] Deleted volume successfully. Apr 29 17:32:39 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-bf1cb8d4-8381-46ff-9975-2f0ae62f40e4 tempest-VolumesCloneTest-333403705 None] Lock "cinder-5a6a25b8-9582-4c26-b0f3-714507672a03-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:32:46 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=122,cinder:DELETE=3,cinder:SELECT=90,cinder:INSERT=31 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:32:46 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:32:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Flow 'volume_create_manager' (34149980-8584-4584-9bcd-eccd1f17d1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:32:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0485b7-ee83-484e-8747-c4a32fe51615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0485b7-ee83-484e-8747-c4a32fe51615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c7d655-96f6-4760-b2dd-f75c04948a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17bfb824b29b4179b758780534b6a4ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:32:46Z,use_quota=True,user_id='849ebec13f174b2f8cedac56264383e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5aaf1d-bcce-4c30-bcbc-dc02ef9cd73d),volume_type_id=7b5aaf1d-bcce-4c30-bcbc-dc02ef9cd73d)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cfe30b3-f406-4332-b9a2-d228e67d3593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cfe30b3-f406-4332-b9a2-d228e67d3593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b82ff22-97ad-47a7-8725-983e8a94f6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:46 devstack cinder-volume[84547]: DEBUG cinder.image.glance [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Creating Keystone auth plugin from conf {{(pid=84547) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 17:32:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b82ff22-97ad-47a7-8725-983e8a94f6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '64c7d655-96f6-4760-b2dd-f75c04948a22', 'volume_name': 'volume-64c7d655-96f6-4760-b2dd-f75c04948a22', 'volume_size': 1, 'image_id': '4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bc8abcf82ebee5c76a90470cffb08304', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '17bfb824b29b4179b758780534b6a4ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5421e02122aba1c455dff2c5869159aa8b1fdcee30118e7320b7cbdba7c390f3147b0675f0722de5852b0768472d64869000f200d8ddf1eec43d4f170e8b79ac', 'id': '4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9', 'created_at': datetime.datetime(2026, 4, 29, 15, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 32, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9f6781-2275-41f7-8632-25e414931ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9f6781-2275-41f7-8632-25e414931ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:46 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877f4b15-301b-441e-b8cb-091f095b184d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:46 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Volume 64c7d655-96f6-4760-b2dd-f75c04948a22: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-64c7d655-96f6-4760-b2dd-f75c04948a22', 'volume_size': 1, 'image_id': '4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bc8abcf82ebee5c76a90470cffb08304', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '17bfb824b29b4179b758780534b6a4ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5421e02122aba1c455dff2c5869159aa8b1fdcee30118e7320b7cbdba7c390f3147b0675f0722de5852b0768472d64869000f200d8ddf1eec43d4f170e8b79ac', 'id': '4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9', 'created_at': datetime.datetime(2026, 4, 29, 15, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 32, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Apr 29 17:32:46 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Trying to clone 64c7d655-96f6-4760-b2dd-f75c04948a22 from image 4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9', 'metadata': {}}]). {{(pid=84547) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 17:32:46 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 17:32:46 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Image download 0.00 MB at 0.00 MB/s Apr 29 17:32:46 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7926beb-0ff9-4460-b62f-3e30a17883f3]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:46 devstack sudo[109083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD Apr 29 17:32:46 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:47 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD" returned: 0 in 0.697s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:47 devstack sudo[109088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD Apr 29 17:32:47 devstack sudo[109088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:48 devstack sudo[109088]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD" returned: 1 in 0.812s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:32:48 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Temporary image 4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9 is fetched for user 849ebec13f174b2f8cedac56264383e3. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 17:32:48 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ad2d7f-0237-4985-b513-a637b9ff7b59]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:48 devstack sudo[109093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD Apr 29 17:32:48 devstack sudo[109093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:48 devstack sudo[109093]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD" returned: 0 in 0.669s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:49 devstack sudo[109097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD Apr 29 17:32:49 devstack sudo[109097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:49 devstack sudo[109097]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD" returned: 1 in 0.680s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:32:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:49 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c7d655-96f6-4760-b2dd-f75c04948a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17bfb824b29b4179b758780534b6a4ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:32:46Z,use_quota=True,user_id='849ebec13f174b2f8cedac56264383e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5aaf1d-bcce-4c30-bcbc-dc02ef9cd73d),volume_type_id=7b5aaf1d-bcce-4c30-bcbc-dc02ef9cd73d)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:32:49 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Creating volume 64c7d655-96f6-4760-b2dd-f75c04948a22 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:32:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:49 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:32:49 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:32:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:49 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:32:49 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:32:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:49 devstack sudo[109102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 1073741824 Apr 29 17:32:49 devstack sudo[109102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:50 devstack sudo[109102]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 1073741824" returned: 0 in 0.871s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:50 devstack sudo[109108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 Apr 29 17:32:50 devstack sudo[109108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:51 devstack sudo[109108]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22" returned: 0 in 0.644s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:32:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:51 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Attempting download of 4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9', 'metadata': {}}])) to volume 64c7d655-96f6-4760-b2dd-f75c04948a22. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 17:32:51 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c17bcb-1d25-4d8d-94bf-07214f200d2f]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_z7pzs59v {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:51 devstack sudo[109111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_z7pzs59v Apr 29 17:32:51 devstack sudo[109111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:52 devstack sudo[109111]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_z7pzs59v" returned: 0 in 0.717s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_z7pzs59v {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:52 devstack sudo[109115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_z7pzs59v Apr 29 17:32:52 devstack sudo[109115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:52 devstack sudo[109115]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_z7pzs59v" returned: 1 in 0.714s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_z7pzs59v' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:32:52 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[970abbac-347f-4be4-ba29-9154919326a2]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:52 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD Apr 29 17:32:52 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:53 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD" returned: 0 in 0.737s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:53 devstack sudo[109123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD Apr 29 17:32:53 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:54 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD" returned: 1 in 0.808s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] 4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9 was raw, converting to raw {{(pid=84547) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:54 devstack sudo[109128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 Apr 29 17:32:54 devstack sudo[109128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Flow 'volume_create_manager' (0dfa46cf-a96c-4189-891a-ee8e3308909c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3763d508-769f-401e-bbc5-507dd9401762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3763d508-769f-401e-bbc5-507dd9401762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-607768822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7820b50-c49f-4ef5-8911-389b9ae6b424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e052527b88c43c08b2aa35080a0ecff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:32:54Z,use_quota=True,user_id='d10d1ff9b4894cda977a1595b33e08e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184d9724-218b-4eb7-969c-3afdc89285c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184d9724-218b-4eb7-969c-3afdc89285c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b240faf3-ff74-4a00-8d38-3f8f1764844d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b240faf3-ff74-4a00-8d38-3f8f1764844d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7820b50-c49f-4ef5-8911-389b9ae6b424', 'volume_name': 'volume-f7820b50-c49f-4ef5-8911-389b9ae6b424', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdfb1faa-1d84-420d-a429-2177e709b880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdfb1faa-1d84-420d-a429-2177e709b880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb5e3a0-bf54-4a4b-bbca-7537b06451c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:54 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Volume f7820b50-c49f-4ef5-8911-389b9ae6b424: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7820b50-c49f-4ef5-8911-389b9ae6b424', 'volume_size': 1} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-607768822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7820b50-c49f-4ef5-8911-389b9ae6b424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e052527b88c43c08b2aa35080a0ecff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:32:54Z,use_quota=True,user_id='d10d1ff9b4894cda977a1595b33e08e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Creating volume f7820b50-c49f-4ef5-8911-389b9ae6b424 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:32:54 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f7820b50-c49f-4ef5-8911-389b9ae6b424 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:54 devstack sudo[109130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f7820b50-c49f-4ef5-8911-389b9ae6b424 1073741824 Apr 29 17:32:54 devstack sudo[109130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Flow 'volume_create_manager' (dc2e5594-04cb-4d69-a3ef-d62536e019f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d3e90db-6cc1-43ee-8764-ddfa089397e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d3e90db-6cc1-43ee-8764-ddfa089397e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-266851630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49ba2df5-e9ee-4a0d-911b-e15a220de14c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e052527b88c43c08b2aa35080a0ecff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:32:55Z,use_quota=True,user_id='d10d1ff9b4894cda977a1595b33e08e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc24eb2d-1ff3-4aef-92a7-e2bb2279d4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc24eb2d-1ff3-4aef-92a7-e2bb2279d4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2696fdcc-d416-44e7-aad4-71b5d81cc2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2696fdcc-d416-44e7-aad4-71b5d81cc2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49ba2df5-e9ee-4a0d-911b-e15a220de14c', 'volume_name': 'volume-49ba2df5-e9ee-4a0d-911b-e15a220de14c', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d80bff-b7e3-4b90-a3b6-ceadd72777b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32d80bff-b7e3-4b90-a3b6-ceadd72777b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6f8ba9-7803-4470-b307-7e2ccbddf5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:54 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Volume 49ba2df5-e9ee-4a0d-911b-e15a220de14c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49ba2df5-e9ee-4a0d-911b-e15a220de14c', 'volume_size': 1} Apr 29 17:32:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:55 devstack sudo[109128]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22" returned: 0 in 0.785s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:55 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9_3jsufgy0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:32:55 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Converted 0.00 MB image at 0.00 MB/s Apr 29 17:32:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:55 devstack sudo[109135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 1G Apr 29 17:32:55 devstack sudo[109135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:55 devstack sudo[109130]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f7820b50-c49f-4ef5-8911-389b9ae6b424 1073741824" returned: 0 in 0.993s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f7820b50-c49f-4ef5-8911-389b9ae6b424 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:55 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f7820b50-c49f-4ef5-8911-389b9ae6b424 Apr 29 17:32:55 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:55 devstack sudo[109135]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 1G" returned: 0 in 0.688s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:55 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ca7b57-fc72-4524-bdd7-498b77cde5a0]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:55 devstack sudo[109145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 Apr 29 17:32:55 devstack sudo[109145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:56 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f7820b50-c49f-4ef5-8911-389b9ae6b424" returned: 0 in 0.652s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:32:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.292s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-266851630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49ba2df5-e9ee-4a0d-911b-e15a220de14c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e052527b88c43c08b2aa35080a0ecff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:32:55Z,use_quota=True,user_id='d10d1ff9b4894cda977a1595b33e08e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:32:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Creating volume 49ba2df5-e9ee-4a0d-911b-e15a220de14c {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:32:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:32:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:32:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:32:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:32:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:32:56 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:32:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49ba2df5-e9ee-4a0d-911b-e15a220de14c 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cb5e3a0-bf54-4a4b-bbca-7537b06451c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7820b50-c49f-4ef5-8911-389b9ae6b424', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (493d9408-25de-4617-aaa8-29507fba79fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:56 devstack sudo[109148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49ba2df5-e9ee-4a0d-911b-e15a220de14c 1073741824 Apr 29 17:32:56 devstack sudo[109148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:56 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Volume volume-f7820b50-c49f-4ef5-8911-389b9ae6b424 (f7820b50-c49f-4ef5-8911-389b9ae6b424): created successfully Apr 29 17:32:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (493d9408-25de-4617-aaa8-29507fba79fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Flow 'volume_create_manager' (0dfa46cf-a96c-4189-891a-ee8e3308909c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:32:56 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-bc023141-d99b-4745-8c38-cb565c4e495e tempest-TestServerVolumeAttachmentScenario-1517229048 None] Created volume successfully. Apr 29 17:32:56 devstack sudo[109145]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22" returned: 0 in 0.775s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:56 devstack sudo[109153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 Apr 29 17:32:56 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:57 devstack sudo[109148]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49ba2df5-e9ee-4a0d-911b-e15a220de14c 1073741824" returned: 0 in 0.930s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49ba2df5-e9ee-4a0d-911b-e15a220de14c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:57 devstack sudo[109160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49ba2df5-e9ee-4a0d-911b-e15a220de14c Apr 29 17:32:57 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:57 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22" returned: 1 in 0.796s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:32:57 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Downloaded image 4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9', 'metadata': {}}])) to volume 64c7d655-96f6-4760-b2dd-f75c04948a22 successfully. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 17:32:57 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Temporary image 4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9 for user 849ebec13f174b2f8cedac56264383e3 is deleted. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 17:32:57 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Marking volume 64c7d655-96f6-4760-b2dd-f75c04948a22 as bootable. {{(pid=84547) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 17:32:57 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Copying metadata from image 4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9 to 64c7d655-96f6-4760-b2dd-f75c04948a22. {{(pid=84547) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 17:32:57 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Creating volume glance metadata for volume 64c7d655-96f6-4760-b2dd-f75c04948a22 backed by image 4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'bc8abcf82ebee5c76a90470cffb08304', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84547) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 17:32:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877f4b15-301b-441e-b8cb-091f095b184d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64c7d655-96f6-4760-b2dd-f75c04948a22', 'volume_size': 1, 'image_id': '4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bc8abcf82ebee5c76a90470cffb08304', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '17bfb824b29b4179b758780534b6a4ad', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5421e02122aba1c455dff2c5869159aa8b1fdcee30118e7320b7cbdba7c390f3147b0675f0722de5852b0768472d64869000f200d8ddf1eec43d4f170e8b79ac', 'id': '4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9', 'created_at': datetime.datetime(2026, 4, 29, 15, 32, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 32, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ffda5d6-b599-4dbf-ae13-fcc7fd0f35e9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3543bc08-8a03-44ab-b40c-ed8736d61b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:57 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Volume volume-64c7d655-96f6-4760-b2dd-f75c04948a22 (64c7d655-96f6-4760-b2dd-f75c04948a22): created successfully Apr 29 17:32:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3543bc08-8a03-44ab-b40c-ed8736d61b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Flow 'volume_create_manager' (34149980-8584-4584-9bcd-eccd1f17d1c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:32:57 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e323eb35-59ec-47f9-914d-467c68a23c0c tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Created volume successfully. Apr 29 17:32:57 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49ba2df5-e9ee-4a0d-911b-e15a220de14c" returned: 0 in 0.666s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:57 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:32:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:32:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6f8ba9-7803-4470-b307-7e2ccbddf5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49ba2df5-e9ee-4a0d-911b-e15a220de14c', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e21aac-1041-433e-8bf8-a43f1d216730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:32:57 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Volume volume-49ba2df5-e9ee-4a0d-911b-e15a220de14c (49ba2df5-e9ee-4a0d-911b-e15a220de14c): created successfully Apr 29 17:32:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e21aac-1041-433e-8bf8-a43f1d216730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:32:58 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Flow 'volume_create_manager' (dc2e5594-04cb-4d69-a3ef-d62536e019f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:32:58 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-b8335734-40b9-4461-9cb0-860f5e9d1849 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Created volume successfully. Apr 29 17:32:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Acquiring lock "cinder-64c7d655-96f6-4760-b2dd-f75c04948a22-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Lock "cinder-64c7d655-96f6-4760-b2dd-f75c04948a22-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Acquiring lock "cinder-quobyte-64c7d655-96f6-4760-b2dd-f75c04948a22" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:32:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Lock "cinder-quobyte-64c7d655-96f6-4760-b2dd-f75c04948a22" acquired by "delete_volume" :: waited 0.020s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:32:58 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84cbee6-5f78-4213-a48e-6295e2754074]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:32:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:58 devstack sudo[109168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 Apr 29 17:32:58 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:58 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22" returned: 0 in 0.691s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:59 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 Apr 29 17:32:59 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:32:59 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Apr 29 17:32:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22" returned: 1 in 0.712s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:32:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:32:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:32:59 devstack sudo[109179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22 Apr 29 17:32:59 devstack sudo[109179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:00 devstack sudo[109179]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-64c7d655-96f6-4760-b2dd-f75c04948a22" returned: 0 in 0.611s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Lock "cinder-quobyte-64c7d655-96f6-4760-b2dd-f75c04948a22" released by "delete_volume" :: held 2.082s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:00 devstack cinder-volume[84547]: WARNING cinder.quota [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:33:00 devstack cinder-volume[84547]: WARNING cinder.quota [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Apr 29 17:33:00 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Created reservations ['85c2c3fc-81da-46f6-b3f1-35053318a8dd', 'e268d688-833b-4af0-901c-4296984f9864', '6b4a02c5-8c95-4aeb-aed5-b91717b7f012', 'ef1575fb-2dc2-4cdd-9686-e17fe7eaba96'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:33:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:00 devstack sudo[109182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:33:00 devstack sudo[109182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:01 devstack sudo[109182]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.607s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:01 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:33:01 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Deleted volume successfully. Apr 29 17:33:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-620b43cb-e922-4e10-b6ef-0bad247ba5c4 tempest-VolumeAndVolumeTypeFromImageTest-1476190989 None] Lock "cinder-64c7d655-96f6-4760-b2dd-f75c04948a22-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:33:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:05 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:33:05 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Flow 'volume_create_manager' (6f16072a-696e-4432-ad2f-576a8fce1bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b0128b2-d796-46f5-b7ee-39b57a79feb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:06 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.645s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b0128b2-d796-46f5-b7ee-39b57a79feb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1547753737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e201c819-55ed-47e5-9be4-6a19140e7018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74108a7aea974726b2ee58ded3b98246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:06Z,use_quota=True,user_id='52f53488ef5045c7a3c2399321a158cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46f128a-5cd8-4159-9ad0-41581fd972bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46f128a-5cd8-4159-9ad0-41581fd972bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (242c6a13-ad7f-4c1f-b34d-eb1e41d5c88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (242c6a13-ad7f-4c1f-b34d-eb1e41d5c88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e201c819-55ed-47e5-9be4-6a19140e7018', 'volume_name': 'volume-e201c819-55ed-47e5-9be4-6a19140e7018', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a76841-cd41-40dd-81f4-299a710318c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7a76841-cd41-40dd-81f4-299a710318c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98e40e2-d4eb-4e93-ae1b-25edafd68648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:06 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Volume e201c819-55ed-47e5-9be4-6a19140e7018: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e201c819-55ed-47e5-9be4-6a19140e7018', 'volume_size': 1} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1547753737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e201c819-55ed-47e5-9be4-6a19140e7018,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74108a7aea974726b2ee58ded3b98246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:06Z,use_quota=True,user_id='52f53488ef5045c7a3c2399321a158cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Creating volume e201c819-55ed-47e5-9be4-6a19140e7018 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:33:06 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e201c819-55ed-47e5-9be4-6a19140e7018 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:06 devstack sudo[109245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e201c819-55ed-47e5-9be4-6a19140e7018 1073741824 Apr 29 17:33:06 devstack sudo[109245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Flow 'volume_create_manager' (efadc5a7-eb1c-4906-9f57-7fa79647b480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c8121e-7801-40f6-a986-5d7f63c8901d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c8121e-7801-40f6-a986-5d7f63c8901d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-411668942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee41d8d4-2572-4523-b658-118ea328a5ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74108a7aea974726b2ee58ded3b98246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:07Z,use_quota=True,user_id='52f53488ef5045c7a3c2399321a158cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c9e8d66-e2c3-4449-8376-d8190b45c209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c9e8d66-e2c3-4449-8376-d8190b45c209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf3c7cc-2555-4437-b53f-796b685e8157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf3c7cc-2555-4437-b53f-796b685e8157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee41d8d4-2572-4523-b658-118ea328a5ea', 'volume_name': 'volume-ee41d8d4-2572-4523-b658-118ea328a5ea', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3fd4ee-6b25-4e78-87ed-e52079890673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e3fd4ee-6b25-4e78-87ed-e52079890673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e6885b-910f-4ef1-bb14-62e7431910d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:06 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Volume ee41d8d4-2572-4523-b658-118ea328a5ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee41d8d4-2572-4523-b658-118ea328a5ea', 'volume_size': 1} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Flow 'volume_create_manager' (bfc3657c-0653-4cb0-b66a-511939c2a697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f58adcc-7424-401a-97f0-689fa70ee7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f58adcc-7424-401a-97f0-689fa70ee7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-246399771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc190ce2-d5ba-49fe-877d-f17f077a46e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74108a7aea974726b2ee58ded3b98246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:07Z,use_quota=True,user_id='52f53488ef5045c7a3c2399321a158cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82384d6f-edf7-42f3-b6c7-a9e8b5241533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82384d6f-edf7-42f3-b6c7-a9e8b5241533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f04720-412d-4a4f-a09a-b969b587f1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f04720-412d-4a4f-a09a-b969b587f1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc190ce2-d5ba-49fe-877d-f17f077a46e5', 'volume_name': 'volume-fc190ce2-d5ba-49fe-877d-f17f077a46e5', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3728d081-51fc-4027-a681-498307572724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3728d081-51fc-4027-a681-498307572724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e74a073a-501e-4396-976e-5a931f2540e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:06 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Volume fc190ce2-d5ba-49fe-877d-f17f077a46e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc190ce2-d5ba-49fe-877d-f17f077a46e5', 'volume_size': 1} Apr 29 17:33:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:07 devstack sudo[109245]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e201c819-55ed-47e5-9be4-6a19140e7018 1073741824" returned: 0 in 0.949s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e201c819-55ed-47e5-9be4-6a19140e7018 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:07 devstack sudo[109252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e201c819-55ed-47e5-9be4-6a19140e7018 Apr 29 17:33:07 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Flow 'volume_create_manager' (0e2ee8c9-f322-4f18-b1b2-c13abbf2a23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0558015-7363-4dc9-970e-7c825e78ed90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0558015-7363-4dc9-970e-7c825e78ed90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1608626790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753b72fa-fba4-45de-9138-15252e6e76f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74108a7aea974726b2ee58ded3b98246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:07Z,use_quota=True,user_id='52f53488ef5045c7a3c2399321a158cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb52d81-62c2-43a3-8824-8f33dc80bdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb52d81-62c2-43a3-8824-8f33dc80bdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca062de3-6103-4f79-ac03-0270072ed8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca062de3-6103-4f79-ac03-0270072ed8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '753b72fa-fba4-45de-9138-15252e6e76f3', 'volume_name': 'volume-753b72fa-fba4-45de-9138-15252e6e76f3', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be376bc8-24f4-4065-ab14-cc8779ea031c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be376bc8-24f4-4065-ab14-cc8779ea031c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5ff5fe-c206-4208-b8c2-ae638a8fee6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:07 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Volume 753b72fa-fba4-45de-9138-15252e6e76f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-753b72fa-fba4-45de-9138-15252e6e76f3', 'volume_size': 1} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Flow 'volume_create_manager' (cc419b00-3c04-4c68-a837-224a8ed0f7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad4220b-9615-41c5-9f5f-5bf2ac4dba59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad4220b-9615-41c5-9f5f-5bf2ac4dba59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1997277320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51cd6db4-fabd-4079-8e0f-73ad53d7d96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74108a7aea974726b2ee58ded3b98246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:08Z,use_quota=True,user_id='52f53488ef5045c7a3c2399321a158cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45401cc-e981-4fea-a26f-766a6f0627e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45401cc-e981-4fea-a26f-766a6f0627e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd4683d-222e-40f6-8850-04daaaf8a9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd4683d-222e-40f6-8850-04daaaf8a9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51cd6db4-fabd-4079-8e0f-73ad53d7d96e', 'volume_name': 'volume-51cd6db4-fabd-4079-8e0f-73ad53d7d96e', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72bb8701-a17e-487d-80e7-516c0ca1ec0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72bb8701-a17e-487d-80e7-516c0ca1ec0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd29593-3e65-4305-8c52-364443e6a20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:07 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Volume 51cd6db4-fabd-4079-8e0f-73ad53d7d96e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51cd6db4-fabd-4079-8e0f-73ad53d7d96e', 'volume_size': 1} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:07 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e201c819-55ed-47e5-9be4-6a19140e7018" returned: 0 in 0.687s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.306s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-411668942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee41d8d4-2572-4523-b658-118ea328a5ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74108a7aea974726b2ee58ded3b98246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:07Z,use_quota=True,user_id='52f53488ef5045c7a3c2399321a158cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Creating volume ee41d8d4-2572-4523-b658-118ea328a5ea {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:33:08 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:33:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ee41d8d4-2572-4523-b658-118ea328a5ea 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d98e40e2-d4eb-4e93-ae1b-25edafd68648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e201c819-55ed-47e5-9be4-6a19140e7018', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3138c100-2d3d-4370-889f-109d597dc4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:08 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ee41d8d4-2572-4523-b658-118ea328a5ea 1073741824 Apr 29 17:33:08 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:08 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Volume volume-e201c819-55ed-47e5-9be4-6a19140e7018 (e201c819-55ed-47e5-9be4-6a19140e7018): created successfully Apr 29 17:33:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3138c100-2d3d-4370-889f-109d597dc4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:08 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Flow 'volume_create_manager' (6f16072a-696e-4432-ad2f-576a8fce1bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:08 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-97863468-e2dd-4b1a-9c5d-7a7f640623ba tempest-CreateVolumesFromImageTest-1181237017 None] Created volume successfully. Apr 29 17:33:08 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ee41d8d4-2572-4523-b658-118ea328a5ea 1073741824" returned: 0 in 0.799s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ee41d8d4-2572-4523-b658-118ea328a5ea {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:08 devstack sudo[109270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ee41d8d4-2572-4523-b658-118ea328a5ea Apr 29 17:33:08 devstack sudo[109270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:09 devstack sudo[109270]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ee41d8d4-2572-4523-b658-118ea328a5ea" returned: 0 in 0.585s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:33:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.414s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-246399771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc190ce2-d5ba-49fe-877d-f17f077a46e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74108a7aea974726b2ee58ded3b98246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:07Z,use_quota=True,user_id='52f53488ef5045c7a3c2399321a158cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:33:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Creating volume fc190ce2-d5ba-49fe-877d-f17f077a46e5 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:33:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:33:09 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:33:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc190ce2-d5ba-49fe-877d-f17f077a46e5 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e6885b-910f-4ef1-bb14-62e7431910d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee41d8d4-2572-4523-b658-118ea328a5ea', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:09 devstack sudo[109273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc190ce2-d5ba-49fe-877d-f17f077a46e5 1073741824 Apr 29 17:33:09 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6daefb43-a968-42a7-ae98-55bc84e0da04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:09 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Volume volume-ee41d8d4-2572-4523-b658-118ea328a5ea (ee41d8d4-2572-4523-b658-118ea328a5ea): created successfully Apr 29 17:33:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6daefb43-a968-42a7-ae98-55bc84e0da04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Flow 'volume_create_manager' (efadc5a7-eb1c-4906-9f57-7fa79647b480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:09 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4450593d-c294-42bd-b4b2-2d548593416c tempest-CreateVolumesFromImageTest-1181237017 None] Created volume successfully. Apr 29 17:33:10 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc190ce2-d5ba-49fe-877d-f17f077a46e5 1073741824" returned: 0 in 1.138s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc190ce2-d5ba-49fe-877d-f17f077a46e5 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:10 devstack sudo[109341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc190ce2-d5ba-49fe-877d-f17f077a46e5 Apr 29 17:33:10 devstack sudo[109341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:11 devstack sudo[109341]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc190ce2-d5ba-49fe-877d-f17f077a46e5" returned: 0 in 0.638s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:33:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.714s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1608626790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753b72fa-fba4-45de-9138-15252e6e76f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74108a7aea974726b2ee58ded3b98246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:07Z,use_quota=True,user_id='52f53488ef5045c7a3c2399321a158cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:33:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Creating volume 753b72fa-fba4-45de-9138-15252e6e76f3 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:33:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:33:11 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:33:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-753b72fa-fba4-45de-9138-15252e6e76f3 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e74a073a-501e-4396-976e-5a931f2540e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc190ce2-d5ba-49fe-877d-f17f077a46e5', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:11 devstack sudo[109345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-753b72fa-fba4-45de-9138-15252e6e76f3 1073741824 Apr 29 17:33:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a2984c-7016-4821-a4dd-63750a965515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:11 devstack sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:11 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Volume volume-fc190ce2-d5ba-49fe-877d-f17f077a46e5 (fc190ce2-d5ba-49fe-877d-f17f077a46e5): created successfully Apr 29 17:33:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a2984c-7016-4821-a4dd-63750a965515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Flow 'volume_create_manager' (bfc3657c-0653-4cb0-b66a-511939c2a697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:11 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-3951374e-6dfe-44a7-a93f-e85c7b77735e tempest-CreateVolumesFromImageTest-1181237017 None] Created volume successfully. Apr 29 17:33:12 devstack sudo[109345]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-753b72fa-fba4-45de-9138-15252e6e76f3 1073741824" returned: 0 in 0.930s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-753b72fa-fba4-45de-9138-15252e6e76f3 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:12 devstack sudo[109351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-753b72fa-fba4-45de-9138-15252e6e76f3 Apr 29 17:33:12 devstack sudo[109351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:12 devstack sudo[109351]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-753b72fa-fba4-45de-9138-15252e6e76f3" returned: 0 in 0.622s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:33:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.105s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1997277320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51cd6db4-fabd-4079-8e0f-73ad53d7d96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74108a7aea974726b2ee58ded3b98246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:08Z,use_quota=True,user_id='52f53488ef5045c7a3c2399321a158cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:33:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Creating volume 51cd6db4-fabd-4079-8e0f-73ad53d7d96e {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:33:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:33:12 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:33:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-51cd6db4-fabd-4079-8e0f-73ad53d7d96e 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5ff5fe-c206-4208-b8c2-ae638a8fee6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-753b72fa-fba4-45de-9138-15252e6e76f3', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:12 devstack sudo[109354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-51cd6db4-fabd-4079-8e0f-73ad53d7d96e 1073741824 Apr 29 17:33:12 devstack sudo[109354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ee544b-e712-4203-a7fc-3419d49ab88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:12 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Volume volume-753b72fa-fba4-45de-9138-15252e6e76f3 (753b72fa-fba4-45de-9138-15252e6e76f3): created successfully Apr 29 17:33:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ee544b-e712-4203-a7fc-3419d49ab88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:12 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Flow 'volume_create_manager' (0e2ee8c9-f322-4f18-b1b2-c13abbf2a23b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:12 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-7f722439-40eb-4f37-8ad0-cf0c5fceb65e tempest-CreateVolumesFromImageTest-1181237017 None] Created volume successfully. Apr 29 17:33:13 devstack sudo[109354]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-51cd6db4-fabd-4079-8e0f-73ad53d7d96e 1073741824" returned: 0 in 0.978s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-51cd6db4-fabd-4079-8e0f-73ad53d7d96e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:13 devstack sudo[109360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-51cd6db4-fabd-4079-8e0f-73ad53d7d96e Apr 29 17:33:13 devstack sudo[109360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:14 devstack sudo[109360]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-51cd6db4-fabd-4079-8e0f-73ad53d7d96e" returned: 0 in 0.697s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:33:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd29593-3e65-4305-8c52-364443e6a20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51cd6db4-fabd-4079-8e0f-73ad53d7d96e', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80faf5ec-c09d-4cb0-92fd-efc78a2bd74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:14 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Volume volume-51cd6db4-fabd-4079-8e0f-73ad53d7d96e (51cd6db4-fabd-4079-8e0f-73ad53d7d96e): created successfully Apr 29 17:33:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80faf5ec-c09d-4cb0-92fd-efc78a2bd74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Flow 'volume_create_manager' (cc419b00-3c04-4c68-a837-224a8ed0f7f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:14 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-931f221a-073c-4057-a135-1550b0eb921c tempest-CreateVolumesFromImageTest-1181237017 None] Created volume successfully. Apr 29 17:33:15 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1d7bec20-06f0-44ed-8eb6-10b69c78859a tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "cinder-51cd6db4-fabd-4079-8e0f-73ad53d7d96e-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:15 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1d7bec20-06f0-44ed-8eb6-10b69c78859a tempest-CreateVolumesFromImageTest-1181237017 None] Lock "cinder-51cd6db4-fabd-4079-8e0f-73ad53d7d96e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:15 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1d7bec20-06f0-44ed-8eb6-10b69c78859a tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "cinder-quobyte-51cd6db4-fabd-4079-8e0f-73ad53d7d96e" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:15 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1d7bec20-06f0-44ed-8eb6-10b69c78859a tempest-CreateVolumesFromImageTest-1181237017 None] Lock "cinder-quobyte-51cd6db4-fabd-4079-8e0f-73ad53d7d96e" acquired by "delete_volume" :: waited 0.020s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:15 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e68b268-010b-4e86-a6a3-8d4491b4c921]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:33:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1d7bec20-06f0-44ed-8eb6-10b69c78859a tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-51cd6db4-fabd-4079-8e0f-73ad53d7d96e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:15 devstack sudo[109365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-51cd6db4-fabd-4079-8e0f-73ad53d7d96e Apr 29 17:33:15 devstack sudo[109365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:16 devstack sudo[109365]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1d7bec20-06f0-44ed-8eb6-10b69c78859a tempest-CreateVolumesFromImageTest-1181237017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-51cd6db4-fabd-4079-8e0f-73ad53d7d96e" returned: 0 in 0.713s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1d7bec20-06f0-44ed-8eb6-10b69c78859a tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-51cd6db4-fabd-4079-8e0f-73ad53d7d96e {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:16 devstack sudo[109370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-51cd6db4-fabd-4079-8e0f-73ad53d7d96e Apr 29 17:33:16 devstack sudo[109370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:17 devstack sudo[109370]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1d7bec20-06f0-44ed-8eb6-10b69c78859a tempest-CreateVolumesFromImageTest-1181237017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-51cd6db4-fabd-4079-8e0f-73ad53d7d96e" returned: 0 in 0.610s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1d7bec20-06f0-44ed-8eb6-10b69c78859a tempest-CreateVolumesFromImageTest-1181237017 None] Lock "cinder-quobyte-51cd6db4-fabd-4079-8e0f-73ad53d7d96e" released by "delete_volume" :: held 1.376s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:17 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-1d7bec20-06f0-44ed-8eb6-10b69c78859a tempest-CreateVolumesFromImageTest-1181237017 None] Created reservations ['ee7c2ad8-e90b-4bdf-a360-e16e45d0fba9', '69bb4399-7229-4d01-949d-6d9c1e601a7e', 'a02e64f0-beeb-40b4-b06f-093b25fbff86', '148fe501-cc7f-499c-acac-717097584401'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:33:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1d7bec20-06f0-44ed-8eb6-10b69c78859a tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1d7bec20-06f0-44ed-8eb6-10b69c78859a tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1d7bec20-06f0-44ed-8eb6-10b69c78859a tempest-CreateVolumesFromImageTest-1181237017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:17 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1d7bec20-06f0-44ed-8eb6-10b69c78859a tempest-CreateVolumesFromImageTest-1181237017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1d7bec20-06f0-44ed-8eb6-10b69c78859a tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1d7bec20-06f0-44ed-8eb6-10b69c78859a tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:17 devstack sudo[109374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:33:17 devstack sudo[109374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:17 devstack sudo[109374]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1d7bec20-06f0-44ed-8eb6-10b69c78859a tempest-CreateVolumesFromImageTest-1181237017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.617s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:17 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-1d7bec20-06f0-44ed-8eb6-10b69c78859a tempest-CreateVolumesFromImageTest-1181237017 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:33:17 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-1d7bec20-06f0-44ed-8eb6-10b69c78859a tempest-CreateVolumesFromImageTest-1181237017 None] Deleted volume successfully. Apr 29 17:33:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1d7bec20-06f0-44ed-8eb6-10b69c78859a tempest-CreateVolumesFromImageTest-1181237017 None] Lock "cinder-51cd6db4-fabd-4079-8e0f-73ad53d7d96e-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8f04c9db-48fe-4365-8a0f-8dfece2ffe4b tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "cinder-753b72fa-fba4-45de-9138-15252e6e76f3-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8f04c9db-48fe-4365-8a0f-8dfece2ffe4b tempest-CreateVolumesFromImageTest-1181237017 None] Lock "cinder-753b72fa-fba4-45de-9138-15252e6e76f3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8f04c9db-48fe-4365-8a0f-8dfece2ffe4b tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "cinder-quobyte-753b72fa-fba4-45de-9138-15252e6e76f3" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8f04c9db-48fe-4365-8a0f-8dfece2ffe4b tempest-CreateVolumesFromImageTest-1181237017 None] Lock "cinder-quobyte-753b72fa-fba4-45de-9138-15252e6e76f3" acquired by "delete_volume" :: waited 0.014s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:17 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8d36fa-998c-45be-a116-42c403e9bea5]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:33:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8f04c9db-48fe-4365-8a0f-8dfece2ffe4b tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-753b72fa-fba4-45de-9138-15252e6e76f3 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:18 devstack sudo[109377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-753b72fa-fba4-45de-9138-15252e6e76f3 Apr 29 17:33:18 devstack sudo[109377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:18 devstack sudo[109377]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8f04c9db-48fe-4365-8a0f-8dfece2ffe4b tempest-CreateVolumesFromImageTest-1181237017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-753b72fa-fba4-45de-9138-15252e6e76f3" returned: 0 in 0.715s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8f04c9db-48fe-4365-8a0f-8dfece2ffe4b tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-753b72fa-fba4-45de-9138-15252e6e76f3 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:18 devstack sudo[109382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-753b72fa-fba4-45de-9138-15252e6e76f3 Apr 29 17:33:18 devstack sudo[109382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:19 devstack sudo[109382]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8f04c9db-48fe-4365-8a0f-8dfece2ffe4b tempest-CreateVolumesFromImageTest-1181237017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-753b72fa-fba4-45de-9138-15252e6e76f3" returned: 0 in 0.630s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8f04c9db-48fe-4365-8a0f-8dfece2ffe4b tempest-CreateVolumesFromImageTest-1181237017 None] Lock "cinder-quobyte-753b72fa-fba4-45de-9138-15252e6e76f3" released by "delete_volume" :: held 1.387s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:19 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-8f04c9db-48fe-4365-8a0f-8dfece2ffe4b tempest-CreateVolumesFromImageTest-1181237017 None] Created reservations ['9a088d67-f246-438d-9a9b-5074b327025b', '0100946d-8d7f-43ac-a2a2-5e4dbc15da08', 'bc51947a-2401-441c-8e05-326850233354', '39055be1-9a58-4c50-bb5d-4be20430ee71'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:33:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8f04c9db-48fe-4365-8a0f-8dfece2ffe4b tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8f04c9db-48fe-4365-8a0f-8dfece2ffe4b tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8f04c9db-48fe-4365-8a0f-8dfece2ffe4b tempest-CreateVolumesFromImageTest-1181237017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8f04c9db-48fe-4365-8a0f-8dfece2ffe4b tempest-CreateVolumesFromImageTest-1181237017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8f04c9db-48fe-4365-8a0f-8dfece2ffe4b tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8f04c9db-48fe-4365-8a0f-8dfece2ffe4b tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:19 devstack sudo[109385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:33:19 devstack sudo[109385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:20 devstack sudo[109385]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8f04c9db-48fe-4365-8a0f-8dfece2ffe4b tempest-CreateVolumesFromImageTest-1181237017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.634s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:20 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-8f04c9db-48fe-4365-8a0f-8dfece2ffe4b tempest-CreateVolumesFromImageTest-1181237017 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:33:20 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-8f04c9db-48fe-4365-8a0f-8dfece2ffe4b tempest-CreateVolumesFromImageTest-1181237017 None] Deleted volume successfully. Apr 29 17:33:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-953cd3b2-eb07-4e0d-9403-5d5770283730 tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "cinder-fc190ce2-d5ba-49fe-877d-f17f077a46e5-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-8f04c9db-48fe-4365-8a0f-8dfece2ffe4b tempest-CreateVolumesFromImageTest-1181237017 None] Lock "cinder-753b72fa-fba4-45de-9138-15252e6e76f3-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-953cd3b2-eb07-4e0d-9403-5d5770283730 tempest-CreateVolumesFromImageTest-1181237017 None] Lock "cinder-fc190ce2-d5ba-49fe-877d-f17f077a46e5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-953cd3b2-eb07-4e0d-9403-5d5770283730 tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "cinder-quobyte-fc190ce2-d5ba-49fe-877d-f17f077a46e5" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-953cd3b2-eb07-4e0d-9403-5d5770283730 tempest-CreateVolumesFromImageTest-1181237017 None] Lock "cinder-quobyte-fc190ce2-d5ba-49fe-877d-f17f077a46e5" acquired by "delete_volume" :: waited 0.014s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:20 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fc8452-a3fe-4e08-97f8-90b6d9c164bb]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:33:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-953cd3b2-eb07-4e0d-9403-5d5770283730 tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc190ce2-d5ba-49fe-877d-f17f077a46e5 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:20 devstack sudo[109388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc190ce2-d5ba-49fe-877d-f17f077a46e5 Apr 29 17:33:20 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:20 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-953cd3b2-eb07-4e0d-9403-5d5770283730 tempest-CreateVolumesFromImageTest-1181237017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc190ce2-d5ba-49fe-877d-f17f077a46e5" returned: 0 in 0.702s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-953cd3b2-eb07-4e0d-9403-5d5770283730 tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc190ce2-d5ba-49fe-877d-f17f077a46e5 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:20 devstack sudo[109393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc190ce2-d5ba-49fe-877d-f17f077a46e5 Apr 29 17:33:20 devstack sudo[109393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:21 devstack sudo[109393]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-953cd3b2-eb07-4e0d-9403-5d5770283730 tempest-CreateVolumesFromImageTest-1181237017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc190ce2-d5ba-49fe-877d-f17f077a46e5" returned: 0 in 0.591s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-953cd3b2-eb07-4e0d-9403-5d5770283730 tempest-CreateVolumesFromImageTest-1181237017 None] Lock "cinder-quobyte-fc190ce2-d5ba-49fe-877d-f17f077a46e5" released by "delete_volume" :: held 1.337s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:21 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-953cd3b2-eb07-4e0d-9403-5d5770283730 tempest-CreateVolumesFromImageTest-1181237017 None] Created reservations ['fd482cc4-8560-4f46-a372-10702be97baf', '6f53701f-78a8-4dba-b4e1-4a63ca8e5143', '79f6f8ec-43fc-4c7c-a665-8c73d2367d62', '6a6cdac6-cf12-47fc-9ed6-2290e8237559'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:33:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-953cd3b2-eb07-4e0d-9403-5d5770283730 tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-953cd3b2-eb07-4e0d-9403-5d5770283730 tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-953cd3b2-eb07-4e0d-9403-5d5770283730 tempest-CreateVolumesFromImageTest-1181237017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-953cd3b2-eb07-4e0d-9403-5d5770283730 tempest-CreateVolumesFromImageTest-1181237017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-953cd3b2-eb07-4e0d-9403-5d5770283730 tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-953cd3b2-eb07-4e0d-9403-5d5770283730 tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:21 devstack sudo[109396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:33:21 devstack sudo[109396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:22 devstack sudo[109396]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-953cd3b2-eb07-4e0d-9403-5d5770283730 tempest-CreateVolumesFromImageTest-1181237017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.616s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:22 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-953cd3b2-eb07-4e0d-9403-5d5770283730 tempest-CreateVolumesFromImageTest-1181237017 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:33:22 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-953cd3b2-eb07-4e0d-9403-5d5770283730 tempest-CreateVolumesFromImageTest-1181237017 None] Deleted volume successfully. Apr 29 17:33:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-953cd3b2-eb07-4e0d-9403-5d5770283730 tempest-CreateVolumesFromImageTest-1181237017 None] Lock "cinder-fc190ce2-d5ba-49fe-877d-f17f077a46e5-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4d211f9e-094a-41bd-a532-aca9b4d88b52 tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "cinder-ee41d8d4-2572-4523-b658-118ea328a5ea-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4d211f9e-094a-41bd-a532-aca9b4d88b52 tempest-CreateVolumesFromImageTest-1181237017 None] Lock "cinder-ee41d8d4-2572-4523-b658-118ea328a5ea-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4d211f9e-094a-41bd-a532-aca9b4d88b52 tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "cinder-quobyte-ee41d8d4-2572-4523-b658-118ea328a5ea" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4d211f9e-094a-41bd-a532-aca9b4d88b52 tempest-CreateVolumesFromImageTest-1181237017 None] Lock "cinder-quobyte-ee41d8d4-2572-4523-b658-118ea328a5ea" acquired by "delete_volume" :: waited 0.015s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:22 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[721b1aef-2cee-47cf-8363-8b4b6eef261f]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:33:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d211f9e-094a-41bd-a532-aca9b4d88b52 tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ee41d8d4-2572-4523-b658-118ea328a5ea {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:22 devstack sudo[109399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ee41d8d4-2572-4523-b658-118ea328a5ea Apr 29 17:33:22 devstack sudo[109399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:23 devstack sudo[109399]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d211f9e-094a-41bd-a532-aca9b4d88b52 tempest-CreateVolumesFromImageTest-1181237017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ee41d8d4-2572-4523-b658-118ea328a5ea" returned: 0 in 0.782s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d211f9e-094a-41bd-a532-aca9b4d88b52 tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ee41d8d4-2572-4523-b658-118ea328a5ea {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:23 devstack sudo[109419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ee41d8d4-2572-4523-b658-118ea328a5ea Apr 29 17:33:23 devstack sudo[109419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:23 devstack sudo[109419]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d211f9e-094a-41bd-a532-aca9b4d88b52 tempest-CreateVolumesFromImageTest-1181237017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ee41d8d4-2572-4523-b658-118ea328a5ea" returned: 0 in 0.580s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4d211f9e-094a-41bd-a532-aca9b4d88b52 tempest-CreateVolumesFromImageTest-1181237017 None] Lock "cinder-quobyte-ee41d8d4-2572-4523-b658-118ea328a5ea" released by "delete_volume" :: held 1.401s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:23 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-4d211f9e-094a-41bd-a532-aca9b4d88b52 tempest-CreateVolumesFromImageTest-1181237017 None] Created reservations ['e1035d80-89b0-422d-9773-2851aec5fe1d', '6e71d9a3-ed62-44cd-b003-8348c385b11b', 'd1a49ccb-364e-4fb8-bff5-912ba12cd140', 'bac89901-0b56-43fe-8767-6ef543d59269'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:33:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4d211f9e-094a-41bd-a532-aca9b4d88b52 tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4d211f9e-094a-41bd-a532-aca9b4d88b52 tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:23 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4d211f9e-094a-41bd-a532-aca9b4d88b52 tempest-CreateVolumesFromImageTest-1181237017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:23 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4d211f9e-094a-41bd-a532-aca9b4d88b52 tempest-CreateVolumesFromImageTest-1181237017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4d211f9e-094a-41bd-a532-aca9b4d88b52 tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d211f9e-094a-41bd-a532-aca9b4d88b52 tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:23 devstack sudo[109422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:33:23 devstack sudo[109422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:24 devstack sudo[109422]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4d211f9e-094a-41bd-a532-aca9b4d88b52 tempest-CreateVolumesFromImageTest-1181237017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.574s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:24 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-4d211f9e-094a-41bd-a532-aca9b4d88b52 tempest-CreateVolumesFromImageTest-1181237017 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:33:24 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4d211f9e-094a-41bd-a532-aca9b4d88b52 tempest-CreateVolumesFromImageTest-1181237017 None] Deleted volume successfully. Apr 29 17:33:24 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4d211f9e-094a-41bd-a532-aca9b4d88b52 tempest-CreateVolumesFromImageTest-1181237017 None] Lock "cinder-ee41d8d4-2572-4523-b658-118ea328a5ea-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:24 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a90c0a8a-547f-4172-b629-ae41e36ccbb4 tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "cinder-e201c819-55ed-47e5-9be4-6a19140e7018-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:24 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a90c0a8a-547f-4172-b629-ae41e36ccbb4 tempest-CreateVolumesFromImageTest-1181237017 None] Lock "cinder-e201c819-55ed-47e5-9be4-6a19140e7018-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:24 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a90c0a8a-547f-4172-b629-ae41e36ccbb4 tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "cinder-quobyte-e201c819-55ed-47e5-9be4-6a19140e7018" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:24 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a90c0a8a-547f-4172-b629-ae41e36ccbb4 tempest-CreateVolumesFromImageTest-1181237017 None] Lock "cinder-quobyte-e201c819-55ed-47e5-9be4-6a19140e7018" acquired by "delete_volume" :: waited 0.014s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:24 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0287835-5f3a-4dbd-82a7-580bdf88d3db]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:33:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a90c0a8a-547f-4172-b629-ae41e36ccbb4 tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e201c819-55ed-47e5-9be4-6a19140e7018 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:24 devstack sudo[109425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e201c819-55ed-47e5-9be4-6a19140e7018 Apr 29 17:33:24 devstack sudo[109425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:25 devstack sudo[109425]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a90c0a8a-547f-4172-b629-ae41e36ccbb4 tempest-CreateVolumesFromImageTest-1181237017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e201c819-55ed-47e5-9be4-6a19140e7018" returned: 0 in 0.708s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a90c0a8a-547f-4172-b629-ae41e36ccbb4 tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e201c819-55ed-47e5-9be4-6a19140e7018 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:25 devstack sudo[109430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e201c819-55ed-47e5-9be4-6a19140e7018 Apr 29 17:33:25 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:25 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a90c0a8a-547f-4172-b629-ae41e36ccbb4 tempest-CreateVolumesFromImageTest-1181237017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e201c819-55ed-47e5-9be4-6a19140e7018" returned: 0 in 0.601s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a90c0a8a-547f-4172-b629-ae41e36ccbb4 tempest-CreateVolumesFromImageTest-1181237017 None] Lock "cinder-quobyte-e201c819-55ed-47e5-9be4-6a19140e7018" released by "delete_volume" :: held 1.348s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:26 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-a90c0a8a-547f-4172-b629-ae41e36ccbb4 tempest-CreateVolumesFromImageTest-1181237017 None] Created reservations ['fbde92c0-1eae-4683-ba99-be8201a4dc36', '0fdef9d4-6786-443c-8459-1608e948312a', '57302cd1-9339-4466-a9b7-cc061fc1f453', '78b1a825-0b48-4762-8ba6-61d94c2dfac1'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:33:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a90c0a8a-547f-4172-b629-ae41e36ccbb4 tempest-CreateVolumesFromImageTest-1181237017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a90c0a8a-547f-4172-b629-ae41e36ccbb4 tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a90c0a8a-547f-4172-b629-ae41e36ccbb4 tempest-CreateVolumesFromImageTest-1181237017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a90c0a8a-547f-4172-b629-ae41e36ccbb4 tempest-CreateVolumesFromImageTest-1181237017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a90c0a8a-547f-4172-b629-ae41e36ccbb4 tempest-CreateVolumesFromImageTest-1181237017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a90c0a8a-547f-4172-b629-ae41e36ccbb4 tempest-CreateVolumesFromImageTest-1181237017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:26 devstack sudo[109433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:33:26 devstack sudo[109433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:26 devstack sudo[109433]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a90c0a8a-547f-4172-b629-ae41e36ccbb4 tempest-CreateVolumesFromImageTest-1181237017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.583s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:26 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-a90c0a8a-547f-4172-b629-ae41e36ccbb4 tempest-CreateVolumesFromImageTest-1181237017 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:33:26 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-a90c0a8a-547f-4172-b629-ae41e36ccbb4 tempest-CreateVolumesFromImageTest-1181237017 None] Deleted volume successfully. Apr 29 17:33:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a90c0a8a-547f-4172-b629-ae41e36ccbb4 tempest-CreateVolumesFromImageTest-1181237017 None] Lock "cinder-e201c819-55ed-47e5-9be4-6a19140e7018-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Flow 'volume_create_manager' (1c963a17-b950-4099-9ac2-2bd8c7dee9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7984438c-7b4a-402b-b266-c18f3b925199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7984438c-7b4a-402b-b266-c18f3b925199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-215146683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114e4bf6-51bb-4c1d-b524-c49af0a5f396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1b1ad2b4ce4c8eaddaefda126a60c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:29Z,use_quota=True,user_id='6b9acd4bfc2b4f83b41c1f09a864d66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0cd1934-c9dc-4798-af3f-c73ab58d674f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0cd1934-c9dc-4798-af3f-c73ab58d674f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2f863c-270f-4ade-a13e-e716f63104b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2f863c-270f-4ade-a13e-e716f63104b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114e4bf6-51bb-4c1d-b524-c49af0a5f396', 'volume_name': 'volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45463292-dc67-49e0-9c4c-b25be5008a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45463292-dc67-49e0-9c4c-b25be5008a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca079792-405b-4615-878d-0ea7a3c5bc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:29 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Volume 114e4bf6-51bb-4c1d-b524-c49af0a5f396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396', 'volume_size': 1} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-215146683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114e4bf6-51bb-4c1d-b524-c49af0a5f396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1b1ad2b4ce4c8eaddaefda126a60c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:29Z,use_quota=True,user_id='6b9acd4bfc2b4f83b41c1f09a864d66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Creating volume 114e4bf6-51bb-4c1d-b524-c49af0a5f396 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:33:29 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:33:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:29 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396 1073741824 Apr 29 17:33:29 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:30 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396 1073741824" returned: 0 in 0.783s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:30 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=92,cinder:SELECT=64,cinder:INSERT=25,cinder:DELETE=10 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:33:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:30 devstack sudo[109444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396 Apr 29 17:33:30 devstack sudo[109444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:30 devstack sudo[109444]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396" returned: 0 in 0.626s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:33:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca079792-405b-4615-878d-0ea7a3c5bc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4409710-df1b-4a86-bc13-4a8102e9d8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:31 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Volume volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396 (114e4bf6-51bb-4c1d-b524-c49af0a5f396): created successfully Apr 29 17:33:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4409710-df1b-4a86-bc13-4a8102e9d8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Flow 'volume_create_manager' (1c963a17-b950-4099-9ac2-2bd8c7dee9fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:31 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-63dd0558-4796-44e1-8452-85916c5adb53 tempest-CreateVolumesFromSnapshotTest-555779472 None] Created volume successfully. Apr 29 17:33:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4dcc513e-0c4b-4dbc-b2bd-34a58659d735 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4dcc513e-0c4b-4dbc-b2bd-34a58659d735 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-4dcc513e-0c4b-4dbc-b2bd-34a58659d735 tempest-CreateVolumesFromSnapshotTest-555779472 None] Creating offline snapshot 77087d3d-8788-4912-8ccb-434a61b7cb48 of volume 114e4bf6-51bb-4c1d-b524-c49af0a5f396 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:33:31 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7ad635-2470-423f-883e-5dfa5c087021]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:33:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dcc513e-0c4b-4dbc-b2bd-34a58659d735 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:31 devstack sudo[109447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396 Apr 29 17:33:31 devstack sudo[109447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:32 devstack sudo[109447]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dcc513e-0c4b-4dbc-b2bd-34a58659d735 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396" returned: 0 in 0.699s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dcc513e-0c4b-4dbc-b2bd-34a58659d735 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.77087d3d-8788-4912-8ccb-434a61b7cb48 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:32 devstack sudo[109452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.77087d3d-8788-4912-8ccb-434a61b7cb48 1G Apr 29 17:33:32 devstack sudo[109452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:33 devstack sudo[109452]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dcc513e-0c4b-4dbc-b2bd-34a58659d735 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.77087d3d-8788-4912-8ccb-434a61b7cb48 1G" returned: 0 in 0.736s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dcc513e-0c4b-4dbc-b2bd-34a58659d735 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.77087d3d-8788-4912-8ccb-434a61b7cb48 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:33 devstack sudo[109458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.77087d3d-8788-4912-8ccb-434a61b7cb48 Apr 29 17:33:33 devstack sudo[109458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:33 devstack sudo[109458]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dcc513e-0c4b-4dbc-b2bd-34a58659d735 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.77087d3d-8788-4912-8ccb-434a61b7cb48" returned: 0 in 0.611s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:33 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-4dcc513e-0c4b-4dbc-b2bd-34a58659d735 tempest-CreateVolumesFromSnapshotTest-555779472 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.77087d3d-8788-4912-8ccb-434a61b7cb48 is being set with open permissions: ugo+rw Apr 29 17:33:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dcc513e-0c4b-4dbc-b2bd-34a58659d735 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.77087d3d-8788-4912-8ccb-434a61b7cb48 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:33 devstack sudo[109463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.77087d3d-8788-4912-8ccb-434a61b7cb48 Apr 29 17:33:33 devstack sudo[109463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:34 devstack sudo[109463]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dcc513e-0c4b-4dbc-b2bd-34a58659d735 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.77087d3d-8788-4912-8ccb-434a61b7cb48" returned: 0 in 0.572s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dcc513e-0c4b-4dbc-b2bd-34a58659d735 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:34 devstack sudo[109466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.info Apr 29 17:33:34 devstack sudo[109466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:35 devstack sudo[109466]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dcc513e-0c4b-4dbc-b2bd-34a58659d735 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.info" returned: 0 in 0.650s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:35 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-4dcc513e-0c4b-4dbc-b2bd-34a58659d735 tempest-CreateVolumesFromSnapshotTest-555779472 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.info is being set with open permissions: ugo+rw Apr 29 17:33:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dcc513e-0c4b-4dbc-b2bd-34a58659d735 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:35 devstack sudo[109471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.info Apr 29 17:33:35 devstack sudo[109471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:35 devstack sudo[109471]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4dcc513e-0c4b-4dbc-b2bd-34a58659d735 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.info" returned: 0 in 0.604s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4dcc513e-0c4b-4dbc-b2bd-34a58659d735 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.956s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:35 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4dcc513e-0c4b-4dbc-b2bd-34a58659d735 tempest-CreateVolumesFromSnapshotTest-555779472 None] Create snapshot completed successfully Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Flow 'volume_create_manager' (5d6b0d2d-b563-45d1-b6c9-119e5908e43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff28bc0-ec26-4a89-8035-74767fc00159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff28bc0-ec26-4a89-8035-74767fc00159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1624176221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9290fe-ac44-4d87-bddb-34261a826ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1b1ad2b4ce4c8eaddaefda126a60c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:36Z,use_quota=True,user_id='6b9acd4bfc2b4f83b41c1f09a864d66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ec5d00-8b9a-4ff2-8095-bd0dda850be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ec5d00-8b9a-4ff2-8095-bd0dda850be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b692fe7d-c8c8-48ef-85d8-a6637154ae3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b692fe7d-c8c8-48ef-85d8-a6637154ae3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db9290fe-ac44-4d87-bddb-34261a826ca2', 'volume_name': 'volume-db9290fe-ac44-4d87-bddb-34261a826ca2', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ed68ea-b477-40f1-a746-f47ee3fb2b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ed68ea-b477-40f1-a746-f47ee3fb2b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0c332a-3f06-4e31-a49e-f92d451c68b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:36 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Volume db9290fe-ac44-4d87-bddb-34261a826ca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db9290fe-ac44-4d87-bddb-34261a826ca2', 'volume_size': 1} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1624176221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9290fe-ac44-4d87-bddb-34261a826ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1b1ad2b4ce4c8eaddaefda126a60c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:36Z,use_quota=True,user_id='6b9acd4bfc2b4f83b41c1f09a864d66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Creating volume db9290fe-ac44-4d87-bddb-34261a826ca2 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:33:36 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-db9290fe-ac44-4d87-bddb-34261a826ca2 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:36 devstack sudo[109474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-db9290fe-ac44-4d87-bddb-34261a826ca2 1073741824 Apr 29 17:33:36 devstack sudo[109474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Flow 'volume_create_manager' (348755bb-f69e-4591-bf9f-b6328b77e9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1202fd73-936c-4e15-8672-009ab1a19080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1202fd73-936c-4e15-8672-009ab1a19080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1932883643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b104667-a1f2-4864-a4cd-3bad46196998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1b1ad2b4ce4c8eaddaefda126a60c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:36Z,use_quota=True,user_id='6b9acd4bfc2b4f83b41c1f09a864d66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb62e3f2-9270-4e5c-bb5c-312c85c2ffe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb62e3f2-9270-4e5c-bb5c-312c85c2ffe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23353db9-c0b7-40e8-b95f-8a4cdd6012b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23353db9-c0b7-40e8-b95f-8a4cdd6012b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b104667-a1f2-4864-a4cd-3bad46196998', 'volume_name': 'volume-2b104667-a1f2-4864-a4cd-3bad46196998', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07d618f-eda7-421c-88a1-558bfa6689a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f07d618f-eda7-421c-88a1-558bfa6689a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a721c81-b231-4e14-9295-dc3251fb7322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:36 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Volume 2b104667-a1f2-4864-a4cd-3bad46196998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b104667-a1f2-4864-a4cd-3bad46196998', 'volume_size': 1} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Flow 'volume_create_manager' (2c416be8-6607-473f-9a27-76c94d057469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4240b7ff-85cb-447d-b822-f18f47127a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4240b7ff-85cb-447d-b822-f18f47127a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-538613945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e0800b-0c9b-42b3-9169-65198f5c2434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1b1ad2b4ce4c8eaddaefda126a60c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:37Z,use_quota=True,user_id='6b9acd4bfc2b4f83b41c1f09a864d66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3cc022-7b06-4a74-9208-346a4d2b6ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb3cc022-7b06-4a74-9208-346a4d2b6ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c2390cd-1ee3-4323-ab99-89ae832b0e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c2390cd-1ee3-4323-ab99-89ae832b0e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68e0800b-0c9b-42b3-9169-65198f5c2434', 'volume_name': 'volume-68e0800b-0c9b-42b3-9169-65198f5c2434', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490401eb-966c-4493-a71e-62d0027f8038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (490401eb-966c-4493-a71e-62d0027f8038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:36 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125cc1b9-e52c-4920-9c4c-7241cc2cc43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:36 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Volume 68e0800b-0c9b-42b3-9169-65198f5c2434: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68e0800b-0c9b-42b3-9169-65198f5c2434', 'volume_size': 1} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:37 devstack sudo[109474]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-db9290fe-ac44-4d87-bddb-34261a826ca2 1073741824" returned: 0 in 0.921s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-db9290fe-ac44-4d87-bddb-34261a826ca2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:37 devstack sudo[109481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-db9290fe-ac44-4d87-bddb-34261a826ca2 Apr 29 17:33:37 devstack sudo[109481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Flow 'volume_create_manager' (f501f982-a44a-4235-ada2-1c470a791953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77f9e7d-f38e-44b3-bee1-9c197c3786ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d77f9e7d-f38e-44b3-bee1-9c197c3786ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-587214719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924eb5cd-bb38-4973-92dd-1085878cffde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1b1ad2b4ce4c8eaddaefda126a60c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:37Z,use_quota=True,user_id='6b9acd4bfc2b4f83b41c1f09a864d66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8bcaf2b-bd89-4e76-8b11-df0b89646c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8bcaf2b-bd89-4e76-8b11-df0b89646c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (820268db-f21f-4de1-8251-4b989c7b520e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (820268db-f21f-4de1-8251-4b989c7b520e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '924eb5cd-bb38-4973-92dd-1085878cffde', 'volume_name': 'volume-924eb5cd-bb38-4973-92dd-1085878cffde', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2faad77-53d2-48a0-88af-9cab726532b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2faad77-53d2-48a0-88af-9cab726532b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ae3294-f94f-470b-98a3-7b90388c35f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:37 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Volume 924eb5cd-bb38-4973-92dd-1085878cffde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-924eb5cd-bb38-4973-92dd-1085878cffde', 'volume_size': 1} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Flow 'volume_create_manager' (2f1d4bef-46ba-45a3-853a-c4cd73afa4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a1bd49-7288-4932-9a55-b81bc69773e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a1bd49-7288-4932-9a55-b81bc69773e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1296771902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08d698c9-ae97-4ae8-8cfe-eb1459a59234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1b1ad2b4ce4c8eaddaefda126a60c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:38Z,use_quota=True,user_id='6b9acd4bfc2b4f83b41c1f09a864d66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b78c9e-ec0b-43fb-805c-cebd3b5f4e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b78c9e-ec0b-43fb-805c-cebd3b5f4e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb549ef-56bf-4bb4-a1f5-fd464a38656a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb549ef-56bf-4bb4-a1f5-fd464a38656a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08d698c9-ae97-4ae8-8cfe-eb1459a59234', 'volume_name': 'volume-08d698c9-ae97-4ae8-8cfe-eb1459a59234', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f7ec3a-79e5-4622-aea6-5ba96c36f108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f7ec3a-79e5-4622-aea6-5ba96c36f108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c6f094-3267-42d3-93e0-4e1363c14331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:37 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Volume 08d698c9-ae97-4ae8-8cfe-eb1459a59234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08d698c9-ae97-4ae8-8cfe-eb1459a59234', 'volume_size': 1} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:37 devstack sudo[109481]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-db9290fe-ac44-4d87-bddb-34261a826ca2" returned: 0 in 0.670s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.303s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1932883643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b104667-a1f2-4864-a4cd-3bad46196998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1b1ad2b4ce4c8eaddaefda126a60c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:36Z,use_quota=True,user_id='6b9acd4bfc2b4f83b41c1f09a864d66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Creating volume 2b104667-a1f2-4864-a4cd-3bad46196998 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:33:37 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2b104667-a1f2-4864-a4cd-3bad46196998 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b0c332a-3f06-4e31-a49e-f92d451c68b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db9290fe-ac44-4d87-bddb-34261a826ca2', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:37 devstack sudo[109492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2b104667-a1f2-4864-a4cd-3bad46196998 1073741824 Apr 29 17:33:37 devstack sudo[109492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce324007-498e-411e-a2eb-5d1df77c9093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:37 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Volume volume-db9290fe-ac44-4d87-bddb-34261a826ca2 (db9290fe-ac44-4d87-bddb-34261a826ca2): created successfully Apr 29 17:33:38 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce324007-498e-411e-a2eb-5d1df77c9093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:38 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Flow 'volume_create_manager' (5d6b0d2d-b563-45d1-b6c9-119e5908e43b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:38 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-cc07690c-adaa-43a5-b4d7-a3b7066deb84 tempest-CreateVolumesFromSnapshotTest-555779472 None] Created volume successfully. Apr 29 17:33:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-885ac4b6-44d5-49a9-b4f3-3bf1aaf64a9b req-03fd9b4f-870d-42eb-b9eb-ebaf1bb27f50 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:38 devstack sudo[109492]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2b104667-a1f2-4864-a4cd-3bad46196998 1073741824" returned: 0 in 0.784s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2b104667-a1f2-4864-a4cd-3bad46196998 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:38 devstack sudo[109498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2b104667-a1f2-4864-a4cd-3bad46196998 Apr 29 17:33:38 devstack sudo[109498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:39 devstack sudo[109498]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2b104667-a1f2-4864-a4cd-3bad46196998" returned: 0 in 0.578s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:33:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.344s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-538613945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e0800b-0c9b-42b3-9169-65198f5c2434,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1b1ad2b4ce4c8eaddaefda126a60c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:37Z,use_quota=True,user_id='6b9acd4bfc2b4f83b41c1f09a864d66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:33:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Creating volume 68e0800b-0c9b-42b3-9169-65198f5c2434 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:33:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:33:39 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:33:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68e0800b-0c9b-42b3-9169-65198f5c2434 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a721c81-b231-4e14-9295-dc3251fb7322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b104667-a1f2-4864-a4cd-3bad46196998', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:39 devstack sudo[109501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68e0800b-0c9b-42b3-9169-65198f5c2434 1073741824 Apr 29 17:33:39 devstack sudo[109501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800f80cf-f5db-4228-a6a8-0b62efd49517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:39 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Volume volume-2b104667-a1f2-4864-a4cd-3bad46196998 (2b104667-a1f2-4864-a4cd-3bad46196998): created successfully Apr 29 17:33:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (800f80cf-f5db-4228-a6a8-0b62efd49517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Flow 'volume_create_manager' (348755bb-f69e-4591-bf9f-b6328b77e9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:39 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e0077a33-9033-40f4-82ba-36a2da0c93b6 tempest-CreateVolumesFromSnapshotTest-555779472 None] Created volume successfully. Apr 29 17:33:40 devstack sudo[109501]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68e0800b-0c9b-42b3-9169-65198f5c2434 1073741824" returned: 0 in 0.744s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68e0800b-0c9b-42b3-9169-65198f5c2434 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:40 devstack sudo[109506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68e0800b-0c9b-42b3-9169-65198f5c2434 Apr 29 17:33:40 devstack sudo[109506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:40 devstack sudo[109506]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68e0800b-0c9b-42b3-9169-65198f5c2434" returned: 0 in 0.582s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:33:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.290s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-587214719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=924eb5cd-bb38-4973-92dd-1085878cffde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1b1ad2b4ce4c8eaddaefda126a60c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:37Z,use_quota=True,user_id='6b9acd4bfc2b4f83b41c1f09a864d66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:33:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Creating volume 924eb5cd-bb38-4973-92dd-1085878cffde {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:33:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:33:40 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:33:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-924eb5cd-bb38-4973-92dd-1085878cffde 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:40 devstack sudo[109509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-924eb5cd-bb38-4973-92dd-1085878cffde 1073741824 Apr 29 17:33:40 devstack sudo[109509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (125cc1b9-e52c-4920-9c4c-7241cc2cc43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68e0800b-0c9b-42b3-9169-65198f5c2434', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8562f4-a14b-4003-8047-d40f14b1ebf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:40 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Volume volume-68e0800b-0c9b-42b3-9169-65198f5c2434 (68e0800b-0c9b-42b3-9169-65198f5c2434): created successfully Apr 29 17:33:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8562f4-a14b-4003-8047-d40f14b1ebf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Flow 'volume_create_manager' (2c416be8-6607-473f-9a27-76c94d057469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:40 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e1e4bcbf-34d7-4fdb-a3e0-33d2aeb356df tempest-CreateVolumesFromSnapshotTest-555779472 None] Created volume successfully. Apr 29 17:33:41 devstack sudo[109509]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-924eb5cd-bb38-4973-92dd-1085878cffde 1073741824" returned: 0 in 0.748s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-924eb5cd-bb38-4973-92dd-1085878cffde {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:41 devstack sudo[109514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-924eb5cd-bb38-4973-92dd-1085878cffde Apr 29 17:33:41 devstack sudo[109514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:42 devstack sudo[109514]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-924eb5cd-bb38-4973-92dd-1085878cffde" returned: 0 in 0.600s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:42 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:33:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.357s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:42 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1296771902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08d698c9-ae97-4ae8-8cfe-eb1459a59234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d1b1ad2b4ce4c8eaddaefda126a60c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:33:38Z,use_quota=True,user_id='6b9acd4bfc2b4f83b41c1f09a864d66a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:33:42 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Creating volume 08d698c9-ae97-4ae8-8cfe-eb1459a59234 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:33:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:42 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:42 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:42 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:33:42 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:33:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-08d698c9-ae97-4ae8-8cfe-eb1459a59234 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:42 devstack sudo[109517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-08d698c9-ae97-4ae8-8cfe-eb1459a59234 1073741824 Apr 29 17:33:42 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ae3294-f94f-470b-98a3-7b90388c35f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-924eb5cd-bb38-4973-92dd-1085878cffde', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313e260b-177b-4a63-87b3-2ead0dfab692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:42 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Volume volume-924eb5cd-bb38-4973-92dd-1085878cffde (924eb5cd-bb38-4973-92dd-1085878cffde): created successfully Apr 29 17:33:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313e260b-177b-4a63-87b3-2ead0dfab692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Flow 'volume_create_manager' (f501f982-a44a-4235-ada2-1c470a791953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:42 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-773df539-143c-43b5-b724-24ce0f6096ae tempest-CreateVolumesFromSnapshotTest-555779472 None] Created volume successfully. Apr 29 17:33:42 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-08d698c9-ae97-4ae8-8cfe-eb1459a59234 1073741824" returned: 0 in 0.749s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-08d698c9-ae97-4ae8-8cfe-eb1459a59234 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:42 devstack sudo[109523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-08d698c9-ae97-4ae8-8cfe-eb1459a59234 Apr 29 17:33:42 devstack sudo[109523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:43 devstack sudo[109523]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-08d698c9-ae97-4ae8-8cfe-eb1459a59234" returned: 0 in 0.597s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:43 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:33:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-885ac4b6-44d5-49a9-b4f3-3bf1aaf64a9b req-03fd9b4f-870d-42eb-b9eb-ebaf1bb27f50 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.433s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c6f094-3267-42d3-93e0-4e1363c14331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08d698c9-ae97-4ae8-8cfe-eb1459a59234', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4a6d5a-a17e-4794-b084-848af6206794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:33:43 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58dc916-ca48-4612-86ca-6aeae66a76fe]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:33:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-885ac4b6-44d5-49a9-b4f3-3bf1aaf64a9b req-03fd9b4f-870d-42eb-b9eb-ebaf1bb27f50 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f7820b50-c49f-4ef5-8911-389b9ae6b424 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:43 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Volume volume-08d698c9-ae97-4ae8-8cfe-eb1459a59234 (08d698c9-ae97-4ae8-8cfe-eb1459a59234): created successfully Apr 29 17:33:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f4a6d5a-a17e-4794-b084-848af6206794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:33:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Flow 'volume_create_manager' (2f1d4bef-46ba-45a3-853a-c4cd73afa4fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:33:43 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4b337742-9ee6-4bae-a0c5-344228965480 tempest-CreateVolumesFromSnapshotTest-555779472 None] Created volume successfully. Apr 29 17:33:43 devstack sudo[109526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f7820b50-c49f-4ef5-8911-389b9ae6b424 Apr 29 17:33:43 devstack sudo[109526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:44 devstack sudo[109526]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-885ac4b6-44d5-49a9-b4f3-3bf1aaf64a9b req-03fd9b4f-870d-42eb-b9eb-ebaf1bb27f50 tempest-TestServerVolumeAttachmentScenario-1517229048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f7820b50-c49f-4ef5-8911-389b9ae6b424" returned: 0 in 0.743s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-885ac4b6-44d5-49a9-b4f3-3bf1aaf64a9b req-03fd9b4f-870d-42eb-b9eb-ebaf1bb27f50 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.771s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:44 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-088a4fe4-82fb-4b01-92cb-2f0855ccd016 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "cinder-08d698c9-ae97-4ae8-8cfe-eb1459a59234-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-885ac4b6-44d5-49a9-b4f3-3bf1aaf64a9b req-03fd9b4f-870d-42eb-b9eb-ebaf1bb27f50 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-f7820b50-c49f-4ef5-8911-389b9ae6b424', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ac843c6-0cc1-4fce-8675-ce2e1e8220b7', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:33:44 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-088a4fe4-82fb-4b01-92cb-2f0855ccd016 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-08d698c9-ae97-4ae8-8cfe-eb1459a59234-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:44 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-088a4fe4-82fb-4b01-92cb-2f0855ccd016 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "cinder-quobyte-08d698c9-ae97-4ae8-8cfe-eb1459a59234" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:44 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-088a4fe4-82fb-4b01-92cb-2f0855ccd016 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-quobyte-08d698c9-ae97-4ae8-8cfe-eb1459a59234" acquired by "delete_volume" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:44 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-885ac4b6-44d5-49a9-b4f3-3bf1aaf64a9b req-03fd9b4f-870d-42eb-b9eb-ebaf1bb27f50 tempest-TestServerVolumeAttachmentScenario-1517229048 None] attachment_update completed successfully. Apr 29 17:33:44 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a67ca1-66e9-4bad-935c-4819c6b13277]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:33:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-088a4fe4-82fb-4b01-92cb-2f0855ccd016 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-08d698c9-ae97-4ae8-8cfe-eb1459a59234 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:44 devstack sudo[109531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-08d698c9-ae97-4ae8-8cfe-eb1459a59234 Apr 29 17:33:44 devstack sudo[109531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:45 devstack sudo[109531]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-088a4fe4-82fb-4b01-92cb-2f0855ccd016 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-08d698c9-ae97-4ae8-8cfe-eb1459a59234" returned: 0 in 0.746s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-088a4fe4-82fb-4b01-92cb-2f0855ccd016 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-08d698c9-ae97-4ae8-8cfe-eb1459a59234 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:45 devstack sudo[109603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-08d698c9-ae97-4ae8-8cfe-eb1459a59234 Apr 29 17:33:45 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:45 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-088a4fe4-82fb-4b01-92cb-2f0855ccd016 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-08d698c9-ae97-4ae8-8cfe-eb1459a59234" returned: 0 in 0.614s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:45 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-088a4fe4-82fb-4b01-92cb-2f0855ccd016 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-quobyte-08d698c9-ae97-4ae8-8cfe-eb1459a59234" released by "delete_volume" :: held 1.399s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:45 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-088a4fe4-82fb-4b01-92cb-2f0855ccd016 tempest-CreateVolumesFromSnapshotTest-555779472 None] Created reservations ['5250da88-a33b-48c8-8952-8fec28bbc62d', '6d1205b6-b991-4335-a0db-1d14f6400d71', 'd20f49eb-4bba-4fe2-abba-3c59e4905867', 'ef713ccd-8a89-49cc-ad5b-5a65b7dd34a0'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:33:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-088a4fe4-82fb-4b01-92cb-2f0855ccd016 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-088a4fe4-82fb-4b01-92cb-2f0855ccd016 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-088a4fe4-82fb-4b01-92cb-2f0855ccd016 tempest-CreateVolumesFromSnapshotTest-555779472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-088a4fe4-82fb-4b01-92cb-2f0855ccd016 tempest-CreateVolumesFromSnapshotTest-555779472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-088a4fe4-82fb-4b01-92cb-2f0855ccd016 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-088a4fe4-82fb-4b01-92cb-2f0855ccd016 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:45 devstack sudo[109921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:33:45 devstack sudo[109921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:46 devstack sudo[109921]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-088a4fe4-82fb-4b01-92cb-2f0855ccd016 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.589s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:46 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-088a4fe4-82fb-4b01-92cb-2f0855ccd016 tempest-CreateVolumesFromSnapshotTest-555779472 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:33:46 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-088a4fe4-82fb-4b01-92cb-2f0855ccd016 tempest-CreateVolumesFromSnapshotTest-555779472 None] Deleted volume successfully. Apr 29 17:33:46 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=75,cinder:INSERT=30,cinder:UPDATE=100,cinder:DELETE=11 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:33:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-267a836a-e4f7-42f7-9580-89316b68fcf1 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "cinder-924eb5cd-bb38-4973-92dd-1085878cffde-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-088a4fe4-82fb-4b01-92cb-2f0855ccd016 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-08d698c9-ae97-4ae8-8cfe-eb1459a59234-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-267a836a-e4f7-42f7-9580-89316b68fcf1 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-924eb5cd-bb38-4973-92dd-1085878cffde-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-267a836a-e4f7-42f7-9580-89316b68fcf1 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "cinder-quobyte-924eb5cd-bb38-4973-92dd-1085878cffde" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-267a836a-e4f7-42f7-9580-89316b68fcf1 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-quobyte-924eb5cd-bb38-4973-92dd-1085878cffde" acquired by "delete_volume" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:46 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ff258d-c0c6-4e76-967a-daeb99a2dae2]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:33:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-267a836a-e4f7-42f7-9580-89316b68fcf1 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-924eb5cd-bb38-4973-92dd-1085878cffde {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:46 devstack sudo[109924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-924eb5cd-bb38-4973-92dd-1085878cffde Apr 29 17:33:46 devstack sudo[109924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:47 devstack sudo[109924]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-267a836a-e4f7-42f7-9580-89316b68fcf1 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-924eb5cd-bb38-4973-92dd-1085878cffde" returned: 0 in 0.712s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-267a836a-e4f7-42f7-9580-89316b68fcf1 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-924eb5cd-bb38-4973-92dd-1085878cffde {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:47 devstack sudo[109931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-924eb5cd-bb38-4973-92dd-1085878cffde Apr 29 17:33:47 devstack sudo[109931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:47 devstack sudo[109931]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-267a836a-e4f7-42f7-9580-89316b68fcf1 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-924eb5cd-bb38-4973-92dd-1085878cffde" returned: 0 in 0.591s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:47 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-267a836a-e4f7-42f7-9580-89316b68fcf1 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-quobyte-924eb5cd-bb38-4973-92dd-1085878cffde" released by "delete_volume" :: held 1.344s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:47 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-267a836a-e4f7-42f7-9580-89316b68fcf1 tempest-CreateVolumesFromSnapshotTest-555779472 None] Created reservations ['787287da-27c3-4d51-97c4-4725b293c8ce', '51976d81-7d30-496b-8157-58a4e2ee10e2', 'c295d301-1c0c-4147-8e48-83269fe2e49e', '5e9ee23d-e044-4d7b-8e59-2b2abe7f4ca3'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:33:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-267a836a-e4f7-42f7-9580-89316b68fcf1 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-267a836a-e4f7-42f7-9580-89316b68fcf1 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-267a836a-e4f7-42f7-9580-89316b68fcf1 tempest-CreateVolumesFromSnapshotTest-555779472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-267a836a-e4f7-42f7-9580-89316b68fcf1 tempest-CreateVolumesFromSnapshotTest-555779472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-267a836a-e4f7-42f7-9580-89316b68fcf1 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-267a836a-e4f7-42f7-9580-89316b68fcf1 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:48 devstack sudo[109934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:33:48 devstack sudo[109934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:48 devstack sudo[109934]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-267a836a-e4f7-42f7-9580-89316b68fcf1 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.608s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:48 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-267a836a-e4f7-42f7-9580-89316b68fcf1 tempest-CreateVolumesFromSnapshotTest-555779472 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:33:48 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-267a836a-e4f7-42f7-9580-89316b68fcf1 tempest-CreateVolumesFromSnapshotTest-555779472 None] Deleted volume successfully. Apr 29 17:33:48 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-267a836a-e4f7-42f7-9580-89316b68fcf1 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-924eb5cd-bb38-4973-92dd-1085878cffde-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:48 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a6615fb9-716c-4b08-8dcb-d5a4779b5362 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "cinder-68e0800b-0c9b-42b3-9169-65198f5c2434-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:48 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a6615fb9-716c-4b08-8dcb-d5a4779b5362 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-68e0800b-0c9b-42b3-9169-65198f5c2434-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:48 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a6615fb9-716c-4b08-8dcb-d5a4779b5362 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "cinder-quobyte-68e0800b-0c9b-42b3-9169-65198f5c2434" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:48 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a6615fb9-716c-4b08-8dcb-d5a4779b5362 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-quobyte-68e0800b-0c9b-42b3-9169-65198f5c2434" acquired by "delete_volume" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:48 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b93b6ee-a0c1-456c-8a50-d405e07ac69b]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:33:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a6615fb9-716c-4b08-8dcb-d5a4779b5362 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68e0800b-0c9b-42b3-9169-65198f5c2434 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:48 devstack sudo[109937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68e0800b-0c9b-42b3-9169-65198f5c2434 Apr 29 17:33:48 devstack sudo[109937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:49 devstack sudo[109937]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a6615fb9-716c-4b08-8dcb-d5a4779b5362 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68e0800b-0c9b-42b3-9169-65198f5c2434" returned: 0 in 0.737s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a6615fb9-716c-4b08-8dcb-d5a4779b5362 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68e0800b-0c9b-42b3-9169-65198f5c2434 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:49 devstack sudo[109942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68e0800b-0c9b-42b3-9169-65198f5c2434 Apr 29 17:33:49 devstack sudo[109942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:50 devstack sudo[109942]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a6615fb9-716c-4b08-8dcb-d5a4779b5362 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-68e0800b-0c9b-42b3-9169-65198f5c2434" returned: 0 in 0.628s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:50 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a6615fb9-716c-4b08-8dcb-d5a4779b5362 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-quobyte-68e0800b-0c9b-42b3-9169-65198f5c2434" released by "delete_volume" :: held 1.408s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:50 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-a6615fb9-716c-4b08-8dcb-d5a4779b5362 tempest-CreateVolumesFromSnapshotTest-555779472 None] Created reservations ['fd1d32c8-fa16-44c6-abc2-9b77442df673', 'aa4aa707-14de-48a7-9ec9-68f21959b883', '5b0a75dc-2ae3-4bfe-8f6e-8879376794fa', '97a482be-b71f-46be-afac-0299163f9f6d'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:33:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a6615fb9-716c-4b08-8dcb-d5a4779b5362 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a6615fb9-716c-4b08-8dcb-d5a4779b5362 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a6615fb9-716c-4b08-8dcb-d5a4779b5362 tempest-CreateVolumesFromSnapshotTest-555779472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a6615fb9-716c-4b08-8dcb-d5a4779b5362 tempest-CreateVolumesFromSnapshotTest-555779472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a6615fb9-716c-4b08-8dcb-d5a4779b5362 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a6615fb9-716c-4b08-8dcb-d5a4779b5362 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:50 devstack sudo[109945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:33:50 devstack sudo[109945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:50 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ec0049f7-7e38-4bed-8631-c9b3318177d3 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "cinder-2b104667-a1f2-4864-a4cd-3bad46196998-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:50 devstack sudo[109945]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a6615fb9-716c-4b08-8dcb-d5a4779b5362 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.636s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:51 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-a6615fb9-716c-4b08-8dcb-d5a4779b5362 tempest-CreateVolumesFromSnapshotTest-555779472 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:33:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ec0049f7-7e38-4bed-8631-c9b3318177d3 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-2b104667-a1f2-4864-a4cd-3bad46196998-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:51 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-a6615fb9-716c-4b08-8dcb-d5a4779b5362 tempest-CreateVolumesFromSnapshotTest-555779472 None] Deleted volume successfully. Apr 29 17:33:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a6615fb9-716c-4b08-8dcb-d5a4779b5362 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-68e0800b-0c9b-42b3-9169-65198f5c2434-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ec0049f7-7e38-4bed-8631-c9b3318177d3 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "cinder-quobyte-2b104667-a1f2-4864-a4cd-3bad46196998" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ec0049f7-7e38-4bed-8631-c9b3318177d3 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-quobyte-2b104667-a1f2-4864-a4cd-3bad46196998" acquired by "delete_volume" :: waited 0.013s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:51 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d74cd8-aa6e-43c3-8114-3f39729b782f]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:33:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec0049f7-7e38-4bed-8631-c9b3318177d3 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2b104667-a1f2-4864-a4cd-3bad46196998 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:51 devstack sudo[109948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2b104667-a1f2-4864-a4cd-3bad46196998 Apr 29 17:33:51 devstack sudo[109948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:51 devstack sudo[109948]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec0049f7-7e38-4bed-8631-c9b3318177d3 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2b104667-a1f2-4864-a4cd-3bad46196998" returned: 0 in 0.696s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec0049f7-7e38-4bed-8631-c9b3318177d3 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2b104667-a1f2-4864-a4cd-3bad46196998 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:51 devstack sudo[109953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2b104667-a1f2-4864-a4cd-3bad46196998 Apr 29 17:33:51 devstack sudo[109953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:52 devstack sudo[109953]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec0049f7-7e38-4bed-8631-c9b3318177d3 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2b104667-a1f2-4864-a4cd-3bad46196998" returned: 0 in 0.584s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ec0049f7-7e38-4bed-8631-c9b3318177d3 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-quobyte-2b104667-a1f2-4864-a4cd-3bad46196998" released by "delete_volume" :: held 1.316s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:52 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-ec0049f7-7e38-4bed-8631-c9b3318177d3 tempest-CreateVolumesFromSnapshotTest-555779472 None] Created reservations ['7ae2e4a5-11b3-446a-bf76-9502d8cc8735', 'fb598a63-5a63-4663-aea2-b46a686dca62', 'd1677469-8fdb-4f69-8044-3be0ef160616', '07ca60cd-25db-49fe-8bf7-06af3e44c973'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:33:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec0049f7-7e38-4bed-8631-c9b3318177d3 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec0049f7-7e38-4bed-8631-c9b3318177d3 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec0049f7-7e38-4bed-8631-c9b3318177d3 tempest-CreateVolumesFromSnapshotTest-555779472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec0049f7-7e38-4bed-8631-c9b3318177d3 tempest-CreateVolumesFromSnapshotTest-555779472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec0049f7-7e38-4bed-8631-c9b3318177d3 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec0049f7-7e38-4bed-8631-c9b3318177d3 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:52 devstack sudo[109956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:33:52 devstack sudo[109956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:53 devstack sudo[109956]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec0049f7-7e38-4bed-8631-c9b3318177d3 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.618s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:53 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-ec0049f7-7e38-4bed-8631-c9b3318177d3 tempest-CreateVolumesFromSnapshotTest-555779472 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:33:53 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ec0049f7-7e38-4bed-8631-c9b3318177d3 tempest-CreateVolumesFromSnapshotTest-555779472 None] Deleted volume successfully. Apr 29 17:33:53 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ec0049f7-7e38-4bed-8631-c9b3318177d3 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-2b104667-a1f2-4864-a4cd-3bad46196998-delete_volume" released by "delete_volume" :: held 2.133s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:53 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f332d3b3-1441-4cff-aa0e-51d8c285f86e tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "cinder-db9290fe-ac44-4d87-bddb-34261a826ca2-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:53 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f332d3b3-1441-4cff-aa0e-51d8c285f86e tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-db9290fe-ac44-4d87-bddb-34261a826ca2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:53 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f332d3b3-1441-4cff-aa0e-51d8c285f86e tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "cinder-quobyte-db9290fe-ac44-4d87-bddb-34261a826ca2" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:53 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f332d3b3-1441-4cff-aa0e-51d8c285f86e tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-quobyte-db9290fe-ac44-4d87-bddb-34261a826ca2" acquired by "delete_volume" :: waited 0.014s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:53 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[213f8ed0-9a6d-4651-9c5d-0056276d8221]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:33:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f332d3b3-1441-4cff-aa0e-51d8c285f86e tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-db9290fe-ac44-4d87-bddb-34261a826ca2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:53 devstack sudo[109959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-db9290fe-ac44-4d87-bddb-34261a826ca2 Apr 29 17:33:53 devstack sudo[109959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-b5fc8105-8c84-4a6e-8968-730b8aacaab1 req-f47df619-2b73-4e14-a712-783a4e02481b tempest-TestServerVolumeAttachmentScenario-1517229048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-b5fc8105-8c84-4a6e-8968-730b8aacaab1 req-f47df619-2b73-4e14-a712-783a4e02481b tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:53 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36a1267-d865-403c-90cd-c963b019d12f]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:33:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-b5fc8105-8c84-4a6e-8968-730b8aacaab1 req-f47df619-2b73-4e14-a712-783a4e02481b tempest-TestServerVolumeAttachmentScenario-1517229048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49ba2df5-e9ee-4a0d-911b-e15a220de14c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:53 devstack sudo[109969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49ba2df5-e9ee-4a0d-911b-e15a220de14c Apr 29 17:33:53 devstack sudo[109969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:54 devstack sudo[109959]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f332d3b3-1441-4cff-aa0e-51d8c285f86e tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-db9290fe-ac44-4d87-bddb-34261a826ca2" returned: 0 in 0.749s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f332d3b3-1441-4cff-aa0e-51d8c285f86e tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-db9290fe-ac44-4d87-bddb-34261a826ca2 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:54 devstack sudo[109974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-db9290fe-ac44-4d87-bddb-34261a826ca2 Apr 29 17:33:54 devstack sudo[109974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:54 devstack sudo[109969]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-b5fc8105-8c84-4a6e-8968-730b8aacaab1 req-f47df619-2b73-4e14-a712-783a4e02481b tempest-TestServerVolumeAttachmentScenario-1517229048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49ba2df5-e9ee-4a0d-911b-e15a220de14c" returned: 0 in 0.726s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-b5fc8105-8c84-4a6e-8968-730b8aacaab1 req-f47df619-2b73-4e14-a712-783a4e02481b tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.745s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-b5fc8105-8c84-4a6e-8968-730b8aacaab1 req-f47df619-2b73-4e14-a712-783a4e02481b tempest-TestServerVolumeAttachmentScenario-1517229048 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-49ba2df5-e9ee-4a0d-911b-e15a220de14c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94bd839a-e8f3-4e4e-950c-d7c0b2d14505', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:33:54 devstack sudo[109974]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f332d3b3-1441-4cff-aa0e-51d8c285f86e tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-db9290fe-ac44-4d87-bddb-34261a826ca2" returned: 0 in 0.607s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f332d3b3-1441-4cff-aa0e-51d8c285f86e tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-quobyte-db9290fe-ac44-4d87-bddb-34261a826ca2" released by "delete_volume" :: held 1.404s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:54 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-b5fc8105-8c84-4a6e-8968-730b8aacaab1 req-f47df619-2b73-4e14-a712-783a4e02481b tempest-TestServerVolumeAttachmentScenario-1517229048 None] attachment_update completed successfully. Apr 29 17:33:54 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-f332d3b3-1441-4cff-aa0e-51d8c285f86e tempest-CreateVolumesFromSnapshotTest-555779472 None] Created reservations ['c1f67bcc-9371-4c23-9905-656b2e2ecf9c', '4d45d08e-78d2-4222-a874-1b925819b38c', '6ab8c0de-6e0f-4602-a947-f4b8d6cd9bb9', '8b15addf-ff9e-462a-ab4b-e4030581183a'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:33:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f332d3b3-1441-4cff-aa0e-51d8c285f86e tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:33:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f332d3b3-1441-4cff-aa0e-51d8c285f86e tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:33:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f332d3b3-1441-4cff-aa0e-51d8c285f86e tempest-CreateVolumesFromSnapshotTest-555779472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:33:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f332d3b3-1441-4cff-aa0e-51d8c285f86e tempest-CreateVolumesFromSnapshotTest-555779472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:33:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f332d3b3-1441-4cff-aa0e-51d8c285f86e tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:33:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f332d3b3-1441-4cff-aa0e-51d8c285f86e tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:54 devstack sudo[109980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:33:54 devstack sudo[109980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:55 devstack sudo[109980]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f332d3b3-1441-4cff-aa0e-51d8c285f86e tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.618s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:55 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-f332d3b3-1441-4cff-aa0e-51d8c285f86e tempest-CreateVolumesFromSnapshotTest-555779472 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:33:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "cinder-77087d3d-8788-4912-8ccb-434a61b7cb48-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:55 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f332d3b3-1441-4cff-aa0e-51d8c285f86e tempest-CreateVolumesFromSnapshotTest-555779472 None] Deleted volume successfully. Apr 29 17:33:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-77087d3d-8788-4912-8ccb-434a61b7cb48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "cinder-quobyte-114e4bf6-51bb-4c1d-b524-c49af0a5f396" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f332d3b3-1441-4cff-aa0e-51d8c285f86e tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-db9290fe-ac44-4d87-bddb-34261a826ca2-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-quobyte-114e4bf6-51bb-4c1d-b524-c49af0a5f396" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "cinder-quobyte-77087d3d-8788-4912-8ccb-434a61b7cb48" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-quobyte-77087d3d-8788-4912-8ccb-434a61b7cb48" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:55 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] Deleting offline snapshot 77087d3d-8788-4912-8ccb-434a61b7cb48 of volume 114e4bf6-51bb-4c1d-b524-c49af0a5f396 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:33:55 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] snapshot_file for this snap is: volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.77087d3d-8788-4912-8ccb-434a61b7cb48 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:33:55 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[68545053-bc38-4d79-8f68-7826e9bf5f76]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:33:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.77087d3d-8788-4912-8ccb-434a61b7cb48 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:55 devstack sudo[109986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.77087d3d-8788-4912-8ccb-434a61b7cb48 Apr 29 17:33:55 devstack sudo[109986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:56 devstack sudo[109986]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.77087d3d-8788-4912-8ccb-434a61b7cb48" returned: 0 in 0.724s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:33:56 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb52f901-05a0-4619-bb4e-183d7604e258]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:33:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:56 devstack sudo[109992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396 Apr 29 17:33:56 devstack sudo[109992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:57 devstack sudo[109992]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396" returned: 0 in 0.735s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.77087d3d-8788-4912-8ccb-434a61b7cb48 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:57 devstack sudo[109998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.77087d3d-8788-4912-8ccb-434a61b7cb48 Apr 29 17:33:57 devstack sudo[109998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:57 devstack sudo[109998]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.77087d3d-8788-4912-8ccb-434a61b7cb48" returned: 0 in 0.670s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.77087d3d-8788-4912-8ccb-434a61b7cb48 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:57 devstack sudo[110004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.77087d3d-8788-4912-8ccb-434a61b7cb48 Apr 29 17:33:57 devstack sudo[110004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:58 devstack sudo[110004]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396.77087d3d-8788-4912-8ccb-434a61b7cb48" returned: 0 in 0.602s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-quobyte-77087d3d-8788-4912-8ccb-434a61b7cb48" released by "_delete_snapshot" :: held 2.852s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-quobyte-114e4bf6-51bb-4c1d-b524-c49af0a5f396" released by "delete_snapshot" :: held 2.876s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:58 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] Created reservations ['4b07d5d5-71b5-4f39-bab0-2a1e971ca520', 'bc3f2156-cbff-4766-bd5c-1224876cd7b1', '4bdc1b6f-dfc1-4524-9fe4-76d803f7c092', '14f7bc2c-d9cb-4963-a406-a1d86978bd06'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:33:58 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] Delete snapshot completed successfully. Apr 29 17:33:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6682055a-099f-4a02-a8dd-16178ab010ba tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-77087d3d-8788-4912-8ccb-434a61b7cb48-delete_snapshot" released by "delete_snapshot" :: held 3.008s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:33:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1376f589-f71d-483d-b81f-c242cdba2f22 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "cinder-114e4bf6-51bb-4c1d-b524-c49af0a5f396-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1376f589-f71d-483d-b81f-c242cdba2f22 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-114e4bf6-51bb-4c1d-b524-c49af0a5f396-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1376f589-f71d-483d-b81f-c242cdba2f22 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "cinder-quobyte-114e4bf6-51bb-4c1d-b524-c49af0a5f396" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:33:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1376f589-f71d-483d-b81f-c242cdba2f22 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-quobyte-114e4bf6-51bb-4c1d-b524-c49af0a5f396" acquired by "delete_volume" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:33:58 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ec52d9-6a72-40d4-b56a-b6fd1aa9dd41]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:33:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1376f589-f71d-483d-b81f-c242cdba2f22 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:58 devstack sudo[110007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396 Apr 29 17:33:58 devstack sudo[110007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:33:59 devstack sudo[110007]: pam_unix(sudo:session): session closed for user root Apr 29 17:33:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1376f589-f71d-483d-b81f-c242cdba2f22 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396" returned: 0 in 0.741s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:33:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1376f589-f71d-483d-b81f-c242cdba2f22 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:33:59 devstack sudo[110015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396 Apr 29 17:33:59 devstack sudo[110015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:00 devstack sudo[110015]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1376f589-f71d-483d-b81f-c242cdba2f22 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-114e4bf6-51bb-4c1d-b524-c49af0a5f396" returned: 0 in 0.599s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1376f589-f71d-483d-b81f-c242cdba2f22 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-quobyte-114e4bf6-51bb-4c1d-b524-c49af0a5f396" released by "delete_volume" :: held 1.415s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:34:00 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-1376f589-f71d-483d-b81f-c242cdba2f22 tempest-CreateVolumesFromSnapshotTest-555779472 None] Created reservations ['805125a0-56c6-4561-8e8d-48b865aeea55', 'c1dd84eb-31a1-4d6d-be4a-4569e11a20ae', 'cb0397b4-d6f2-47dc-87f3-5afe5d5ebe04', 'ca9fcb65-269c-4aef-8559-4f33dc4ba130'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:34:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1376f589-f71d-483d-b81f-c242cdba2f22 tempest-CreateVolumesFromSnapshotTest-555779472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:34:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1376f589-f71d-483d-b81f-c242cdba2f22 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:34:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1376f589-f71d-483d-b81f-c242cdba2f22 tempest-CreateVolumesFromSnapshotTest-555779472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:34:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1376f589-f71d-483d-b81f-c242cdba2f22 tempest-CreateVolumesFromSnapshotTest-555779472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:34:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1376f589-f71d-483d-b81f-c242cdba2f22 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:34:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1376f589-f71d-483d-b81f-c242cdba2f22 tempest-CreateVolumesFromSnapshotTest-555779472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:00 devstack sudo[110018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:34:00 devstack sudo[110018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:00 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-f1218df7-0107-4121-8c7f-432a5ba4476c req-295ba26e-e9ea-4c0e-a4e7-5c3470b193f9 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Terminate volume connection completed successfully. Apr 29 17:34:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f1218df7-0107-4121-8c7f-432a5ba4476c req-295ba26e-e9ea-4c0e-a4e7-5c3470b193f9 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Deleting attachment 94bd839a-e8f3-4e4e-950c-d7c0b2d14505. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:34:00 devstack sudo[110018]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1376f589-f71d-483d-b81f-c242cdba2f22 tempest-CreateVolumesFromSnapshotTest-555779472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.597s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:00 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-1376f589-f71d-483d-b81f-c242cdba2f22 tempest-CreateVolumesFromSnapshotTest-555779472 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:34:00 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-1376f589-f71d-483d-b81f-c242cdba2f22 tempest-CreateVolumesFromSnapshotTest-555779472 None] Deleted volume successfully. Apr 29 17:34:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1376f589-f71d-483d-b81f-c242cdba2f22 tempest-CreateVolumesFromSnapshotTest-555779472 None] Lock "cinder-114e4bf6-51bb-4c1d-b524-c49af0a5f396-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:34:04 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-59c1eb4c-1f75-49f7-ad68-fd03f7f75a69 req-307f7b2a-10c5-4ff1-a8f7-6486b8fe44d4 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Terminate volume connection completed successfully. Apr 29 17:34:04 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-59c1eb4c-1f75-49f7-ad68-fd03f7f75a69 req-307f7b2a-10c5-4ff1-a8f7-6486b8fe44d4 tempest-TestServerVolumeAttachmentScenario-1517229048 None] Deleting attachment 2ac843c6-0cc1-4fce-8675-ce2e1e8220b7. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:34:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:34:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:34:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:34:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:34:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:34:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:34:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:05 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:34:05 devstack sudo[110093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:34:05 devstack sudo[110093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:05 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Flow 'volume_create_manager' (17e27bfd-0eef-440d-ae9a-1b6e05fa698f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:34:05 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f698baef-aa46-4e6b-8206-af6c3d49f970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:34:05 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f698baef-aa46-4e6b-8206-af6c3d49f970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f90150e-d7df-4cfe-a74c-8a6e210c3ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0355fd6ad39b4789a215d76c8506190a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:34:06Z,use_quota=True,user_id='fe39f35caad74781963a6ea186bd880f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:34:05 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fc4ff49-43f7-40ca-812d-b27d48e3afd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:34:05 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fc4ff49-43f7-40ca-812d-b27d48e3afd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:34:05 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6cf447-cead-4084-8d5a-00791f7a4b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:34:05 devstack cinder-volume[84547]: DEBUG cinder.image.glance [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Creating Keystone auth plugin from conf {{(pid=84547) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 17:34:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6cf447-cead-4084-8d5a-00791f7a4b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3f90150e-d7df-4cfe-a74c-8a6e210c3ead', 'volume_name': 'volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead', 'volume_size': 1, 'image_id': '09c76888-4ed2-44d2-b152-655207523b81', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09c76888-4ed2-44d2-b152-655207523b81', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '529ebe912164dd5c7bc751793fbee2c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0355fd6ad39b4789a215d76c8506190a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c2571319d6a9b97054b67c552f5c676743ea0b1435b04619cfa34509a53e8f2e1de5ec3ea207701acea01cba758863853d1a6854e8fea3d8275a45ccdc33a0e', 'id': '09c76888-4ed2-44d2-b152-655207523b81', 'created_at': datetime.datetime(2026, 4, 29, 15, 34, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 34, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09c76888-4ed2-44d2-b152-655207523b81/file', 'properties': {}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:34:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0f2c14-396a-44e9-ac6a-bcb2b9ae56f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:34:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0f2c14-396a-44e9-ac6a-bcb2b9ae56f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:34:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a35c0da-6b82-48d6-a546-93f6179d5577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:34:06 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Volume 3f90150e-d7df-4cfe-a74c-8a6e210c3ead: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead', 'volume_size': 1, 'image_id': '09c76888-4ed2-44d2-b152-655207523b81', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09c76888-4ed2-44d2-b152-655207523b81', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '529ebe912164dd5c7bc751793fbee2c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0355fd6ad39b4789a215d76c8506190a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c2571319d6a9b97054b67c552f5c676743ea0b1435b04619cfa34509a53e8f2e1de5ec3ea207701acea01cba758863853d1a6854e8fea3d8275a45ccdc33a0e', 'id': '09c76888-4ed2-44d2-b152-655207523b81', 'created_at': datetime.datetime(2026, 4, 29, 15, 34, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 34, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09c76888-4ed2-44d2-b152-655207523b81/file', 'properties': {}}, 'image_service': } Apr 29 17:34:06 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Trying to clone 3f90150e-d7df-4cfe-a74c-8a6e210c3ead from image 09c76888-4ed2-44d2-b152-655207523b81 at location (None, [{'url': 'file:///opt/stack/data/glance/images/09c76888-4ed2-44d2-b152-655207523b81', 'metadata': {}}]). {{(pid=84547) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 17:34:06 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 17:34:06 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Image download 0.00 MB at 0.00 MB/s Apr 29 17:34:06 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f67a65-3dc7-4dab-ac58-68f7053fe556]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:34:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:06 devstack sudo[110093]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.727s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:34:06 devstack sudo[110099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD Apr 29 17:34:06 devstack sudo[110099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:06 devstack sudo[110099]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD" returned: 0 in 0.745s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:07 devstack sudo[110104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD Apr 29 17:34:07 devstack sudo[110104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:07 devstack sudo[110104]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD" returned: 1 in 0.693s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:34:07 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Temporary image 09c76888-4ed2-44d2-b152-655207523b81 is fetched for user fe39f35caad74781963a6ea186bd880f. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 17:34:07 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c14480-6438-4e97-8127-470e9e8cba7f]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:34:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:07 devstack sudo[110118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD Apr 29 17:34:07 devstack sudo[110118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:08 devstack sudo[110118]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD" returned: 0 in 0.793s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:08 devstack sudo[110156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD Apr 29 17:34:08 devstack sudo[110156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:09 devstack sudo[110156]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD" returned: 1 in 0.695s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:34:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:34:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:34:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f90150e-d7df-4cfe-a74c-8a6e210c3ead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0355fd6ad39b4789a215d76c8506190a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:34:06Z,use_quota=True,user_id='fe39f35caad74781963a6ea186bd880f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:34:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Creating volume 3f90150e-d7df-4cfe-a74c-8a6e210c3ead {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:34:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:34:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:34:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:34:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:34:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:34:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:34:09 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:34:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:09 devstack sudo[110161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead 1073741824 Apr 29 17:34:09 devstack sudo[110161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:10 devstack sudo[110161]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead 1073741824" returned: 0 in 0.850s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:10 devstack sudo[110168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead Apr 29 17:34:10 devstack sudo[110168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:10 devstack sudo[110168]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead" returned: 0 in 0.589s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:34:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:34:10 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Attempting download of 09c76888-4ed2-44d2-b152-655207523b81 ((None, [{'url': 'file:///opt/stack/data/glance/images/09c76888-4ed2-44d2-b152-655207523b81', 'metadata': {}}])) to volume 3f90150e-d7df-4cfe-a74c-8a6e210c3ead. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 17:34:10 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[637873b9-4e9d-4233-96e2-4e2c5ef708a5]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:34:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09c76888-4ed2-44d2-b152-655207523b81_dwnu10pv {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:10 devstack sudo[110171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09c76888-4ed2-44d2-b152-655207523b81_dwnu10pv Apr 29 17:34:10 devstack sudo[110171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:11 devstack sudo[110171]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09c76888-4ed2-44d2-b152-655207523b81_dwnu10pv" returned: 0 in 0.701s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09c76888-4ed2-44d2-b152-655207523b81_dwnu10pv {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:11 devstack sudo[110175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09c76888-4ed2-44d2-b152-655207523b81_dwnu10pv Apr 29 17:34:11 devstack sudo[110175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:12 devstack sudo[110175]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09c76888-4ed2-44d2-b152-655207523b81_dwnu10pv" returned: 1 in 0.688s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09c76888-4ed2-44d2-b152-655207523b81_dwnu10pv' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:34:12 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2ab545-4287-4dd6-a9c9-ad18e1c40c9f]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:34:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:12 devstack sudo[110179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD Apr 29 17:34:12 devstack sudo[110179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:12 devstack sudo[110179]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD" returned: 0 in 0.687s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:13 devstack sudo[110183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD Apr 29 17:34:13 devstack sudo[110183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:13 devstack sudo[110183]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD" returned: 1 in 0.696s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:34:13 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] 09c76888-4ed2-44d2-b152-655207523b81 was raw, converting to raw {{(pid=84547) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 17:34:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:13 devstack sudo[110188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead Apr 29 17:34:13 devstack sudo[110188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:14 devstack sudo[110188]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead" returned: 0 in 0.709s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:14 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_09c76888-4ed2-44d2-b152-655207523b81_ylofzv23devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:34:14 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Converted 0.00 MB image at 0.00 MB/s Apr 29 17:34:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:14 devstack sudo[110193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead 1G Apr 29 17:34:14 devstack sudo[110193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:14 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6d64ac98-9e7e-4487-a55d-190b719c97ec tempest-TestServerVolumeAttachmentScenario-1517229048 None] Acquiring lock "cinder-49ba2df5-e9ee-4a0d-911b-e15a220de14c-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:34:14 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6d64ac98-9e7e-4487-a55d-190b719c97ec tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "cinder-49ba2df5-e9ee-4a0d-911b-e15a220de14c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:34:14 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6d64ac98-9e7e-4487-a55d-190b719c97ec tempest-TestServerVolumeAttachmentScenario-1517229048 None] Acquiring lock "cinder-quobyte-49ba2df5-e9ee-4a0d-911b-e15a220de14c" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:34:14 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6d64ac98-9e7e-4487-a55d-190b719c97ec tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "cinder-quobyte-49ba2df5-e9ee-4a0d-911b-e15a220de14c" acquired by "delete_volume" :: waited 0.015s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:34:14 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4f5a9b-cd2b-4df2-9b95-803bf75debaf]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:34:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6d64ac98-9e7e-4487-a55d-190b719c97ec tempest-TestServerVolumeAttachmentScenario-1517229048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49ba2df5-e9ee-4a0d-911b-e15a220de14c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:14 devstack sudo[110193]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead 1G" returned: 0 in 0.664s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:14 devstack sudo[110198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49ba2df5-e9ee-4a0d-911b-e15a220de14c Apr 29 17:34:14 devstack sudo[110198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:15 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[7390d9cb-4f13-4772-828a-07e211fd196e]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:34:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:15 devstack sudo[110200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead Apr 29 17:34:15 devstack sudo[110200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:15 devstack sudo[110198]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6d64ac98-9e7e-4487-a55d-190b719c97ec tempest-TestServerVolumeAttachmentScenario-1517229048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49ba2df5-e9ee-4a0d-911b-e15a220de14c" returned: 0 in 0.694s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6d64ac98-9e7e-4487-a55d-190b719c97ec tempest-TestServerVolumeAttachmentScenario-1517229048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49ba2df5-e9ee-4a0d-911b-e15a220de14c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:15 devstack sudo[110205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49ba2df5-e9ee-4a0d-911b-e15a220de14c Apr 29 17:34:15 devstack sudo[110205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:15 devstack sudo[110200]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead" returned: 0 in 0.705s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:15 devstack sudo[110209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead Apr 29 17:34:15 devstack sudo[110209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:16 devstack sudo[110205]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6d64ac98-9e7e-4487-a55d-190b719c97ec tempest-TestServerVolumeAttachmentScenario-1517229048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-49ba2df5-e9ee-4a0d-911b-e15a220de14c" returned: 0 in 0.601s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6d64ac98-9e7e-4487-a55d-190b719c97ec tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "cinder-quobyte-49ba2df5-e9ee-4a0d-911b-e15a220de14c" released by "delete_volume" :: held 1.333s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-6d64ac98-9e7e-4487-a55d-190b719c97ec tempest-TestServerVolumeAttachmentScenario-1517229048 None] Created reservations ['b162b9d8-a6fd-4dcb-9cd6-f34d3c19861e', 'c1c822f4-5df4-44cb-8ddc-1d0858d7e712', '57216e5b-fdb3-4fda-a37e-2c30163e96a0', '7581f447-e9ef-4c4c-99a0-f97faa1f8828'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6d64ac98-9e7e-4487-a55d-190b719c97ec tempest-TestServerVolumeAttachmentScenario-1517229048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6d64ac98-9e7e-4487-a55d-190b719c97ec tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-6d64ac98-9e7e-4487-a55d-190b719c97ec tempest-TestServerVolumeAttachmentScenario-1517229048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-6d64ac98-9e7e-4487-a55d-190b719c97ec tempest-TestServerVolumeAttachmentScenario-1517229048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6d64ac98-9e7e-4487-a55d-190b719c97ec tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6d64ac98-9e7e-4487-a55d-190b719c97ec tempest-TestServerVolumeAttachmentScenario-1517229048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:16 devstack sudo[110212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:34:16 devstack sudo[110212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:16 devstack sudo[110209]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead" returned: 1 in 0.698s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Downloaded image 09c76888-4ed2-44d2-b152-655207523b81 ((None, [{'url': 'file:///opt/stack/data/glance/images/09c76888-4ed2-44d2-b152-655207523b81', 'metadata': {}}])) to volume 3f90150e-d7df-4cfe-a74c-8a6e210c3ead successfully. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Temporary image 09c76888-4ed2-44d2-b152-655207523b81 for user fe39f35caad74781963a6ea186bd880f is deleted. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Marking volume 3f90150e-d7df-4cfe-a74c-8a6e210c3ead as bootable. {{(pid=84547) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Copying metadata from image 09c76888-4ed2-44d2-b152-655207523b81 to 3f90150e-d7df-4cfe-a74c-8a6e210c3ead. {{(pid=84547) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Creating volume glance metadata for volume 3f90150e-d7df-4cfe-a74c-8a6e210c3ead backed by image 09c76888-4ed2-44d2-b152-655207523b81 with: {'image_id': '09c76888-4ed2-44d2-b152-655207523b81', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '529ebe912164dd5c7bc751793fbee2c9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84547) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a35c0da-6b82-48d6-a546-93f6179d5577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead', 'volume_size': 1, 'image_id': '09c76888-4ed2-44d2-b152-655207523b81', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09c76888-4ed2-44d2-b152-655207523b81', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '529ebe912164dd5c7bc751793fbee2c9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0355fd6ad39b4789a215d76c8506190a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c2571319d6a9b97054b67c552f5c676743ea0b1435b04619cfa34509a53e8f2e1de5ec3ea207701acea01cba758863853d1a6854e8fea3d8275a45ccdc33a0e', 'id': '09c76888-4ed2-44d2-b152-655207523b81', 'created_at': datetime.datetime(2026, 4, 29, 15, 34, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 34, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09c76888-4ed2-44d2-b152-655207523b81/file', 'properties': {}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f66bf3-8f29-4ef7-b21a-4ce8f6fe1fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:34:16 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Volume volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead (3f90150e-d7df-4cfe-a74c-8a6e210c3ead): created successfully Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f66bf3-8f29-4ef7-b21a-4ce8f6fe1fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Flow 'volume_create_manager' (17e27bfd-0eef-440d-ae9a-1b6e05fa698f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:34:16 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-9f92595c-2f6d-4e43-ab14-d4737ae8d7c1 tempest-VolumeImageDependencyTests-180448046 None] Created volume successfully. Apr 29 17:34:16 devstack sudo[110212]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6d64ac98-9e7e-4487-a55d-190b719c97ec tempest-TestServerVolumeAttachmentScenario-1517229048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.585s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-6d64ac98-9e7e-4487-a55d-190b719c97ec tempest-TestServerVolumeAttachmentScenario-1517229048 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:34:16 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-6d64ac98-9e7e-4487-a55d-190b719c97ec tempest-TestServerVolumeAttachmentScenario-1517229048 None] Deleted volume successfully. Apr 29 17:34:16 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6d64ac98-9e7e-4487-a55d-190b719c97ec tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "cinder-49ba2df5-e9ee-4a0d-911b-e15a220de14c-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:34:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1bcb3aba-ef81-4ae6-88d9-34a0dec7f12a tempest-TestServerVolumeAttachmentScenario-1517229048 None] Acquiring lock "cinder-f7820b50-c49f-4ef5-8911-389b9ae6b424-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:34:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1bcb3aba-ef81-4ae6-88d9-34a0dec7f12a tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "cinder-f7820b50-c49f-4ef5-8911-389b9ae6b424-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:34:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1bcb3aba-ef81-4ae6-88d9-34a0dec7f12a tempest-TestServerVolumeAttachmentScenario-1517229048 None] Acquiring lock "cinder-quobyte-f7820b50-c49f-4ef5-8911-389b9ae6b424" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:34:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1bcb3aba-ef81-4ae6-88d9-34a0dec7f12a tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "cinder-quobyte-f7820b50-c49f-4ef5-8911-389b9ae6b424" acquired by "delete_volume" :: waited 0.014s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:34:17 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edd7d30-5d70-4f57-ae13-7396f0028ed6]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:34:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bcb3aba-ef81-4ae6-88d9-34a0dec7f12a tempest-TestServerVolumeAttachmentScenario-1517229048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f7820b50-c49f-4ef5-8911-389b9ae6b424 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:17 devstack sudo[110219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f7820b50-c49f-4ef5-8911-389b9ae6b424 Apr 29 17:34:17 devstack sudo[110219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] Acquiring lock "cinder-3f90150e-d7df-4cfe-a74c-8a6e210c3ead-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:34:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] Lock "cinder-3f90150e-d7df-4cfe-a74c-8a6e210c3ead-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:34:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] Acquiring lock "cinder-quobyte-3f90150e-d7df-4cfe-a74c-8a6e210c3ead" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:34:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] Lock "cinder-quobyte-3f90150e-d7df-4cfe-a74c-8a6e210c3ead" acquired by "delete_volume" :: waited 0.015s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:34:17 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee7ee29-aaaf-4c1c-8995-7fbeff85ab6b]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:34:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:17 devstack sudo[110221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead Apr 29 17:34:17 devstack sudo[110221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:17 devstack sudo[110219]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bcb3aba-ef81-4ae6-88d9-34a0dec7f12a tempest-TestServerVolumeAttachmentScenario-1517229048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f7820b50-c49f-4ef5-8911-389b9ae6b424" returned: 0 in 0.718s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bcb3aba-ef81-4ae6-88d9-34a0dec7f12a tempest-TestServerVolumeAttachmentScenario-1517229048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f7820b50-c49f-4ef5-8911-389b9ae6b424 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:17 devstack sudo[110228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f7820b50-c49f-4ef5-8911-389b9ae6b424 Apr 29 17:34:17 devstack sudo[110228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:18 devstack sudo[110221]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead" returned: 0 in 0.725s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:18 devstack sudo[110232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead Apr 29 17:34:18 devstack sudo[110232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:18 devstack sudo[110228]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bcb3aba-ef81-4ae6-88d9-34a0dec7f12a tempest-TestServerVolumeAttachmentScenario-1517229048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f7820b50-c49f-4ef5-8911-389b9ae6b424" returned: 0 in 0.599s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:18 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1bcb3aba-ef81-4ae6-88d9-34a0dec7f12a tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "cinder-quobyte-f7820b50-c49f-4ef5-8911-389b9ae6b424" released by "delete_volume" :: held 1.364s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:34:18 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-1bcb3aba-ef81-4ae6-88d9-34a0dec7f12a tempest-TestServerVolumeAttachmentScenario-1517229048 None] Created reservations ['0497ac7c-f12e-4061-bebe-3213b2252c4e', 'd5edce1d-f799-4993-98a7-73203e28190f', '76612062-bcf8-4131-8874-84e28e4b5716', '2df0993d-e3cb-4e2d-b91a-033b5947f690'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:34:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1bcb3aba-ef81-4ae6-88d9-34a0dec7f12a tempest-TestServerVolumeAttachmentScenario-1517229048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:34:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1bcb3aba-ef81-4ae6-88d9-34a0dec7f12a tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:34:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1bcb3aba-ef81-4ae6-88d9-34a0dec7f12a tempest-TestServerVolumeAttachmentScenario-1517229048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:34:18 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1bcb3aba-ef81-4ae6-88d9-34a0dec7f12a tempest-TestServerVolumeAttachmentScenario-1517229048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:34:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1bcb3aba-ef81-4ae6-88d9-34a0dec7f12a tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:34:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bcb3aba-ef81-4ae6-88d9-34a0dec7f12a tempest-TestServerVolumeAttachmentScenario-1517229048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:18 devstack sudo[110235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:34:18 devstack sudo[110235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:18 devstack sudo[110232]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead" returned: 1 in 0.708s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:34:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:18 devstack sudo[110240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead Apr 29 17:34:18 devstack sudo[110240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:19 devstack sudo[110235]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1bcb3aba-ef81-4ae6-88d9-34a0dec7f12a tempest-TestServerVolumeAttachmentScenario-1517229048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.643s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:19 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-1bcb3aba-ef81-4ae6-88d9-34a0dec7f12a tempest-TestServerVolumeAttachmentScenario-1517229048 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:34:19 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-1bcb3aba-ef81-4ae6-88d9-34a0dec7f12a tempest-TestServerVolumeAttachmentScenario-1517229048 None] Deleted volume successfully. Apr 29 17:34:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-1bcb3aba-ef81-4ae6-88d9-34a0dec7f12a tempest-TestServerVolumeAttachmentScenario-1517229048 None] Lock "cinder-f7820b50-c49f-4ef5-8911-389b9ae6b424-delete_volume" released by "delete_volume" :: held 2.218s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:34:19 devstack sudo[110240]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3f90150e-d7df-4cfe-a74c-8a6e210c3ead" returned: 0 in 0.615s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] Lock "cinder-quobyte-3f90150e-d7df-4cfe-a74c-8a6e210c3ead" released by "delete_volume" :: held 2.113s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:34:19 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] Created reservations ['c8a5b1fe-317b-47f9-aac8-ea3bf7bf469f', '48fd0814-8a21-404f-9e71-4e142b1f0ddc', 'dcefad70-94be-4133-87fa-96f207cfbe2d', '0c7e78be-315e-4021-9f80-87d9f8b7ad28'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:34:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:34:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:34:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:34:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:34:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:34:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:19 devstack sudo[110244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:34:19 devstack sudo[110244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:20 devstack sudo[110244]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.615s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:20 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:34:20 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] Deleted volume successfully. Apr 29 17:34:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e0afa68f-6c86-4485-a910-795f6d384b5c tempest-VolumeImageDependencyTests-180448046 None] Lock "cinder-3f90150e-d7df-4cfe-a74c-8a6e210c3ead-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:34:29 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=68,cinder:INSERT=24,cinder:UPDATE=79,cinder:DELETE=4 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:34:30 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=101,cinder:SELECT=81,cinder:DELETE=8,cinder:INSERT=26 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:34:48 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:34:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Flow 'volume_create_manager' (3e200854-e0aa-4348-8ab6-fa22662668d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:34:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1217516e-e6d0-4588-be14-5adbf41a7ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:34:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1217516e-e6d0-4588-be14-5adbf41a7ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2130958547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1eb0e34-fac1-4c93-95dc-f72dbf0d2200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='498c55b0aedc4064a89392b82f09b807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:34:49Z,use_quota=True,user_id='e5ecff42a75f4081bd978e1f9bf35089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:34:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331bc892-2f82-482e-890a-7ba0bfdf1ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:34:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331bc892-2f82-482e-890a-7ba0bfdf1ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:34:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787f93ac-26ab-4912-9238-435af612122a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:34:48 devstack cinder-volume[84547]: DEBUG cinder.image.glance [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Creating Keystone auth plugin from conf {{(pid=84547) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 17:34:49 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787f93ac-26ab-4912-9238-435af612122a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f1eb0e34-fac1-4c93-95dc-f72dbf0d2200', 'volume_name': 'volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:34:49 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813db4be-9b13-4984-a924-444978da6b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:34:49 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813db4be-9b13-4984-a924-444978da6b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:34:49 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1990e64c-4825-4ac4-8bb5-f8e387ec06b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:34:49 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Volume f1eb0e34-fac1-4c93-95dc-f72dbf0d2200: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 17:34:49 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Trying to clone f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 from image 982d68c3-05b9-445d-85e5-5c92642a92aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]). {{(pid=84547) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 17:34:49 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_8wpksrrmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 17:34:49 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Image download 20.69 MB at 20.69 MB/s Apr 29 17:34:49 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[42335046-b208-41e0-b150-d13dc6bcbd87]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:34:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_8wpksrrmdevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:49 devstack sudo[110257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_8wpksrrmdevstack@QuobyteHD Apr 29 17:34:49 devstack sudo[110257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:50 devstack sudo[110257]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_8wpksrrmdevstack@QuobyteHD" returned: 0 in 0.670s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:50 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Temporary image 982d68c3-05b9-445d-85e5-5c92642a92aa is fetched for user e5ecff42a75f4081bd978e1f9bf35089. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 17:34:50 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba0b2bc-a8d4-455e-b117-22bbcd72a252]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:34:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_8wpksrrmdevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:50 devstack sudo[110262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_8wpksrrmdevstack@QuobyteHD Apr 29 17:34:50 devstack sudo[110262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:50 devstack sudo[110262]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_8wpksrrmdevstack@QuobyteHD" returned: 0 in 0.696s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:34:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:34:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2130958547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1eb0e34-fac1-4c93-95dc-f72dbf0d2200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='498c55b0aedc4064a89392b82f09b807',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:34:49Z,use_quota=True,user_id='e5ecff42a75f4081bd978e1f9bf35089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:34:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Creating volume f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:34:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:34:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:34:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:34:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:34:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:34:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:34:50 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:34:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:50 devstack sudo[110267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 1073741824 Apr 29 17:34:50 devstack sudo[110267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:51 devstack sudo[110267]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 1073741824" returned: 0 in 0.738s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:51 devstack sudo[110273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 Apr 29 17:34:51 devstack sudo[110273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:52 devstack sudo[110273]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200" returned: 0 in 0.581s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:34:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:34:52 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Attempting download of 982d68c3-05b9-445d-85e5-5c92642a92aa ((None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}])) to volume f1eb0e34-fac1-4c93-95dc-f72dbf0d2200. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 17:34:52 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e53822-adc5-4631-bfef-fe4b79c5b3eb]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:34:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_mp7i9n8a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:52 devstack sudo[110276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_mp7i9n8a Apr 29 17:34:52 devstack sudo[110276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:52 devstack sudo[110276]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_mp7i9n8a" returned: 0 in 0.671s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_mp7i9n8a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:53 devstack sudo[110280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_mp7i9n8a Apr 29 17:34:53 devstack sudo[110280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:53 devstack sudo[110280]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_mp7i9n8a" returned: 1 in 0.677s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_982d68c3-05b9-445d-85e5-5c92642a92aa_mp7i9n8a' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:34:53 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3103657-352d-4189-8963-7d5d71d91ea0]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:34:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_8wpksrrmdevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:53 devstack sudo[110284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_8wpksrrmdevstack@QuobyteHD Apr 29 17:34:53 devstack sudo[110284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:54 devstack sudo[110284]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_8wpksrrmdevstack@QuobyteHD" returned: 0 in 0.653s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:54 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] 982d68c3-05b9-445d-85e5-5c92642a92aa was qcow2, converting to raw {{(pid=84547) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 17:34:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_8wpksrrmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:54 devstack sudo[110289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_8wpksrrmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 Apr 29 17:34:54 devstack sudo[110289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:56 devstack sudo[110289]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_8wpksrrmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200" returned: 0 in 1.717s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:56 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_982d68c3-05b9-445d-85e5-5c92642a92aa_8wpksrrmdevstack@QuobyteHD, size 112.00 MB, duration 1.72 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:34:56 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Converted 112.00 MB image at 65.17 MB/s Apr 29 17:34:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:56 devstack sudo[110300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 1G Apr 29 17:34:56 devstack sudo[110300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:56 devstack sudo[110300]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 1G" returned: 0 in 0.624s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:56 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[864bb89f-ee99-495b-af81-c9e58d1ac7b1]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:34:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:56 devstack sudo[110306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 Apr 29 17:34:56 devstack sudo[110306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:57 devstack sudo[110306]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200" returned: 0 in 0.715s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:34:57 devstack sudo[110312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 Apr 29 17:34:57 devstack sudo[110312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:34:58 devstack sudo[110312]: pam_unix(sudo:session): session closed for user root Apr 29 17:34:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200" returned: 1 in 0.739s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:34:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:34:58 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Downloaded image 982d68c3-05b9-445d-85e5-5c92642a92aa ((None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}])) to volume f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 successfully. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 17:34:58 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Temporary image 982d68c3-05b9-445d-85e5-5c92642a92aa for user e5ecff42a75f4081bd978e1f9bf35089 is deleted. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 17:34:58 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Marking volume f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 as bootable. {{(pid=84547) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 17:34:58 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Copying metadata from image 982d68c3-05b9-445d-85e5-5c92642a92aa to f1eb0e34-fac1-4c93-95dc-f72dbf0d2200. {{(pid=84547) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 17:34:58 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Creating volume glance metadata for volume f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 backed by image 982d68c3-05b9-445d-85e5-5c92642a92aa with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84547) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 17:34:58 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1990e64c-4825-4ac4-8bb5-f8e387ec06b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200', 'volume_size': 1, 'image_id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/982d68c3-05b9-445d-85e5-5c92642a92aa', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0e131edf8157444d81f6401a4e05fd0a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '982d68c3-05b9-445d-85e5-5c92642a92aa', 'created_at': datetime.datetime(2026, 4, 29, 15, 4, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 4, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/982d68c3-05b9-445d-85e5-5c92642a92aa/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:34:58 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9160d75-6566-41fe-a261-39681537edbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:34:58 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Volume volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 (f1eb0e34-fac1-4c93-95dc-f72dbf0d2200): created successfully Apr 29 17:34:58 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9160d75-6566-41fe-a261-39681537edbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:34:58 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Flow 'volume_create_manager' (3e200854-e0aa-4348-8ab6-fa22662668d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:34:58 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-fb3303f2-9f38-48dd-902b-dacde3f864e4 tempest-TestShelveInstance-716546458 None] Created volume successfully. Apr 29 17:35:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-ce5cb64b-0180-4eef-abae-d38b5fc4cdaf req-2ae63798-e358-4946-9d49-f2b68545d06e tempest-TestShelveInstance-716546458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:35:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-ce5cb64b-0180-4eef-abae-d38b5fc4cdaf req-2ae63798-e358-4946-9d49-f2b68545d06e tempest-TestShelveInstance-716546458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:35:06 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[00214133-71c9-4635-b56e-ddf6d91c43d6]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:35:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-ce5cb64b-0180-4eef-abae-d38b5fc4cdaf req-2ae63798-e358-4946-9d49-f2b68545d06e tempest-TestShelveInstance-716546458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:35:06 devstack sudo[110370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 Apr 29 17:35:06 devstack sudo[110370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:35:07 devstack sudo[110370]: pam_unix(sudo:session): session closed for user root Apr 29 17:35:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-ce5cb64b-0180-4eef-abae-d38b5fc4cdaf req-2ae63798-e358-4946-9d49-f2b68545d06e tempest-TestShelveInstance-716546458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200" returned: 0 in 0.736s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:35:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-ce5cb64b-0180-4eef-abae-d38b5fc4cdaf req-2ae63798-e358-4946-9d49-f2b68545d06e tempest-TestShelveInstance-716546458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:35:07 devstack sudo[110377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 Apr 29 17:35:07 devstack sudo[110377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:35:07 devstack sudo[110377]: pam_unix(sudo:session): session closed for user root Apr 29 17:35:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-ce5cb64b-0180-4eef-abae-d38b5fc4cdaf req-2ae63798-e358-4946-9d49-f2b68545d06e tempest-TestShelveInstance-716546458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200" returned: 1 in 0.702s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:35:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-ce5cb64b-0180-4eef-abae-d38b5fc4cdaf req-2ae63798-e358-4946-9d49-f2b68545d06e tempest-TestShelveInstance-716546458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:35:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-ce5cb64b-0180-4eef-abae-d38b5fc4cdaf req-2ae63798-e358-4946-9d49-f2b68545d06e tempest-TestShelveInstance-716546458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.485s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:35:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-ce5cb64b-0180-4eef-abae-d38b5fc4cdaf req-2ae63798-e358-4946-9d49-f2b68545d06e tempest-TestShelveInstance-716546458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '004a6d57-2a9c-4ffc-b302-9b29e1948847', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:35:07 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-ce5cb64b-0180-4eef-abae-d38b5fc4cdaf req-2ae63798-e358-4946-9d49-f2b68545d06e tempest-TestShelveInstance-716546458 None] attachment_update completed successfully. Apr 29 17:35:17 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=16,cinder:INSERT=5,cinder:UPDATE=6 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:35:17 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=6,cinder:SELECT=14,cinder:INSERT=9,cinder:DELETE=1 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:35:43 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-5632c425-0c24-4ad8-9d6e-8bf38a7f9673 req-269f6d67-9603-47ba-aba0-7f66ae26dc24 tempest-TestShelveInstance-716546458 None] Terminate volume connection completed successfully. Apr 29 17:35:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-5632c425-0c24-4ad8-9d6e-8bf38a7f9673 req-269f6d67-9603-47ba-aba0-7f66ae26dc24 tempest-TestShelveInstance-716546458 None] Deleting attachment 004a6d57-2a9c-4ffc-b302-9b29e1948847. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:35:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-66befab0-ccf2-459e-a828-f97649a55a1c req-4c1baad7-796a-42c7-aecc-3eb8f5eeb040 tempest-TestShelveInstance-716546458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:35:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-66befab0-ccf2-459e-a828-f97649a55a1c req-4c1baad7-796a-42c7-aecc-3eb8f5eeb040 tempest-TestShelveInstance-716546458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:35:48 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc388da-171d-4c1e-87e0-462758ec8ae4]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:35:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-66befab0-ccf2-459e-a828-f97649a55a1c req-4c1baad7-796a-42c7-aecc-3eb8f5eeb040 tempest-TestShelveInstance-716546458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:35:48 devstack sudo[111001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 Apr 29 17:35:48 devstack sudo[111001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:35:49 devstack sudo[111001]: pam_unix(sudo:session): session closed for user root Apr 29 17:35:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-66befab0-ccf2-459e-a828-f97649a55a1c req-4c1baad7-796a-42c7-aecc-3eb8f5eeb040 tempest-TestShelveInstance-716546458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200" returned: 0 in 0.672s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:35:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-66befab0-ccf2-459e-a828-f97649a55a1c req-4c1baad7-796a-42c7-aecc-3eb8f5eeb040 tempest-TestShelveInstance-716546458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:35:49 devstack sudo[111005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 Apr 29 17:35:49 devstack sudo[111005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:35:49 devstack sudo[111005]: pam_unix(sudo:session): session closed for user root Apr 29 17:35:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-66befab0-ccf2-459e-a828-f97649a55a1c req-4c1baad7-796a-42c7-aecc-3eb8f5eeb040 tempest-TestShelveInstance-716546458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200" returned: 1 in 0.680s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:35:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-66befab0-ccf2-459e-a828-f97649a55a1c req-4c1baad7-796a-42c7-aecc-3eb8f5eeb040 tempest-TestShelveInstance-716546458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:35:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-66befab0-ccf2-459e-a828-f97649a55a1c req-4c1baad7-796a-42c7-aecc-3eb8f5eeb040 tempest-TestShelveInstance-716546458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.395s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:35:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-66befab0-ccf2-459e-a828-f97649a55a1c req-4c1baad7-796a-42c7-aecc-3eb8f5eeb040 tempest-TestShelveInstance-716546458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6', 'name': 'volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7db1599e-e722-4e40-888c-5e9f6f309fe4', 'enforce_multipath': True} {{(pid=84547) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 17:35:50 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-66befab0-ccf2-459e-a828-f97649a55a1c req-4c1baad7-796a-42c7-aecc-3eb8f5eeb040 tempest-TestShelveInstance-716546458 None] attachment_update completed successfully. Apr 29 17:36:00 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=3,cinder:SELECT=4 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:36:00 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=10,cinder:UPDATE=1 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:36:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:36:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:36:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:36:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:36:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:36:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:36:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:05 devstack sudo[111459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:36:05 devstack sudo[111459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:06 devstack sudo[111459]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.610s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:36:26 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-5a62d7d3-c408-4554-bab2-fa24bd33ca0e tempest-TestShelveInstance-716546458 None] Terminate volume connection completed successfully. Apr 29 17:36:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-5a62d7d3-c408-4554-bab2-fa24bd33ca0e tempest-TestShelveInstance-716546458 None] Deleting attachment 7db1599e-e722-4e40-888c-5e9f6f309fe4. {{(pid=84547) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 17:36:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] Acquiring lock "cinder-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:36:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] Lock "cinder-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:36:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] Acquiring lock "cinder-quobyte-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:36:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] Lock "cinder-quobyte-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200" acquired by "delete_volume" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:36:26 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[45396505-4a0d-403f-b76d-267a9a7fd5bc]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:36:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:27 devstack sudo[111588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 Apr 29 17:36:27 devstack sudo[111588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:27 devstack sudo[111588]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200" returned: 0 in 0.735s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:27 devstack sudo[111592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 Apr 29 17:36:27 devstack sudo[111592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:28 devstack sudo[111592]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200" returned: 1 in 0.672s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:36:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:28 devstack sudo[111597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200 Apr 29 17:36:28 devstack sudo[111597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:28 devstack sudo[111597]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200" returned: 0 in 0.608s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] Lock "cinder-quobyte-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200" released by "delete_volume" :: held 2.088s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:36:29 devstack cinder-volume[84547]: DEBUG cinder.quota [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] Created reservations ['d284cd94-3b3d-4f81-bc6a-da87a11f8fed', 'fb0aaa67-8b58-4ffc-8d3c-4e09a579b409', '9a49ff9f-c684-4d39-a949-e8a562fc6da6', 'b789532b-668c-47e8-add8-acd5f3dc02ab'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:36:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:36:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:36:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:36:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:36:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:36:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:29 devstack sudo[111600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:36:29 devstack sudo[111600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:29 devstack sudo[111600]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.607s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:29 devstack cinder-volume[84547]: DEBUG cinder.manager [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:36:29 devstack cinder-volume[84547]: INFO cinder.volume.manager [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] Deleted volume successfully. Apr 29 17:36:29 devstack cinder-volume[84547]: DEBUG cinder.coordination [req-f0ca4aac-4cd7-4ca6-92cf-027319c9e96a req-dc74df53-51cb-4512-9636-24bb98ff46da tempest-TestShelveInstance-716546458 None] Lock "cinder-f1eb0e34-fac1-4c93-95dc-f72dbf0d2200-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:36:39 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:36:39 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Flow 'volume_create_manager' (33f3d414-e934-47f5-a85a-217132a97f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4e9eb5-a76c-4bb2-9b32-530b09d6eb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d4e9eb5-a76c-4bb2-9b32-530b09d6eb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1795414295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74bf5d5b-c16c-468f-b385-bfbf48e3810c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8a530e01324aab870a99f24734b30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:36:40Z,use_quota=True,user_id='bae11a317b3545acadf1a3c81a4f0d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb93b34-6bf9-4f5c-b9e5-319d4f0fa951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb93b34-6bf9-4f5c-b9e5-319d4f0fa951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd6756a-32ff-45aa-b401-578b48745701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd6756a-32ff-45aa-b401-578b48745701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74bf5d5b-c16c-468f-b385-bfbf48e3810c', 'volume_name': 'volume-74bf5d5b-c16c-468f-b385-bfbf48e3810c', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9b6c3a-fa4b-48b1-9268-80490fe40430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9b6c3a-fa4b-48b1-9268-80490fe40430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d158e63-bee0-4c43-b8e5-04f11389a2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:40 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Volume 74bf5d5b-c16c-468f-b385-bfbf48e3810c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74bf5d5b-c16c-468f-b385-bfbf48e3810c', 'volume_size': 1} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:36:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1795414295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74bf5d5b-c16c-468f-b385-bfbf48e3810c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8a530e01324aab870a99f24734b30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:36:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:36:40Z,use_quota=True,user_id='bae11a317b3545acadf1a3c81a4f0d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Creating volume 74bf5d5b-c16c-468f-b385-bfbf48e3810c {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:36:40 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:36:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74bf5d5b-c16c-468f-b385-bfbf48e3810c 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:40 devstack sudo[111608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74bf5d5b-c16c-468f-b385-bfbf48e3810c 1073741824 Apr 29 17:36:40 devstack sudo[111608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:41 devstack sudo[111608]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74bf5d5b-c16c-468f-b385-bfbf48e3810c 1073741824" returned: 0 in 0.761s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74bf5d5b-c16c-468f-b385-bfbf48e3810c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:41 devstack sudo[111613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74bf5d5b-c16c-468f-b385-bfbf48e3810c Apr 29 17:36:41 devstack sudo[111613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:41 devstack sudo[111613]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74bf5d5b-c16c-468f-b385-bfbf48e3810c" returned: 0 in 0.596s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:41 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:36:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:36:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d158e63-bee0-4c43-b8e5-04f11389a2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74bf5d5b-c16c-468f-b385-bfbf48e3810c', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b010bd26-1f22-48d7-a3e8-e313c3e3ff1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:41 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Volume volume-74bf5d5b-c16c-468f-b385-bfbf48e3810c (74bf5d5b-c16c-468f-b385-bfbf48e3810c): created successfully Apr 29 17:36:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b010bd26-1f22-48d7-a3e8-e313c3e3ff1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:41 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Flow 'volume_create_manager' (33f3d414-e934-47f5-a85a-217132a97f48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:36:41 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-417e4863-9fc5-4230-b352-8cc879860157 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Created volume successfully. Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Flow 'volume_create_manager' (41e582db-9709-4362-8bb5-b64c82ed99d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e8b84a-b0f7-4316-a9e8-8f9dfdf89b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e8b84a-b0f7-4316-a9e8-8f9dfdf89b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2026714982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f24fd9-4623-4549-a241-307d8e440ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8a530e01324aab870a99f24734b30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:36:43Z,use_quota=True,user_id='bae11a317b3545acadf1a3c81a4f0d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6c5e2c-031b-4fd4-a764-54733339d756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6c5e2c-031b-4fd4-a764-54733339d756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50a4f9d-a98a-447a-9911-fcb45f0b2b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d50a4f9d-a98a-447a-9911-fcb45f0b2b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5f24fd9-4623-4549-a241-307d8e440ad3', 'volume_name': 'volume-c5f24fd9-4623-4549-a241-307d8e440ad3', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0774f7b5-2f95-45e3-a10b-42ab566e3f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0774f7b5-2f95-45e3-a10b-42ab566e3f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb28171d-89b1-425d-bce7-17fed6cda549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:42 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Volume c5f24fd9-4623-4549-a241-307d8e440ad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5f24fd9-4623-4549-a241-307d8e440ad3', 'volume_size': 1} Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2026714982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5f24fd9-4623-4549-a241-307d8e440ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8a530e01324aab870a99f24734b30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:36:43Z,use_quota=True,user_id='bae11a317b3545acadf1a3c81a4f0d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Creating volume c5f24fd9-4623-4549-a241-307d8e440ad3 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:36:42 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:36:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c5f24fd9-4623-4549-a241-307d8e440ad3 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:42 devstack sudo[111617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c5f24fd9-4623-4549-a241-307d8e440ad3 1073741824 Apr 29 17:36:42 devstack sudo[111617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Flow 'volume_create_manager' (2cb614f5-a8a7-4b72-8e9a-6382ae60f0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5373a942-f30f-4896-8368-e614458fd0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5373a942-f30f-4896-8368-e614458fd0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-40863439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e07a736-0b59-42e8-89e6-7c90ac19a063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8a530e01324aab870a99f24734b30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:36:43Z,use_quota=True,user_id='bae11a317b3545acadf1a3c81a4f0d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9d741c-5c40-42e1-89f6-40a57db3fdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9d741c-5c40-42e1-89f6-40a57db3fdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232b1382-04be-4515-a0a1-0d53ebd2dd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232b1382-04be-4515-a0a1-0d53ebd2dd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e07a736-0b59-42e8-89e6-7c90ac19a063', 'volume_name': 'volume-4e07a736-0b59-42e8-89e6-7c90ac19a063', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4c32db-ab33-458a-851b-4811eb40a48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d4c32db-ab33-458a-851b-4811eb40a48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611ef449-6156-4722-97ba-9dd51245b72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:43 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Volume 4e07a736-0b59-42e8-89e6-7c90ac19a063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e07a736-0b59-42e8-89e6-7c90ac19a063', 'volume_size': 1} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Flow 'volume_create_manager' (4a10a28c-1dc7-418d-889e-1339341e6c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f169af14-e75e-4b60-a1e6-0d3ebbdfb163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f169af14-e75e-4b60-a1e6-0d3ebbdfb163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-443832772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dbbe0d6-9ac6-4228-a009-9906c0535ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8a530e01324aab870a99f24734b30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:36:43Z,use_quota=True,user_id='bae11a317b3545acadf1a3c81a4f0d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1498005a-48c8-46d8-bb2e-89cae3901d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1498005a-48c8-46d8-bb2e-89cae3901d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f41d86-6e39-4a02-aa12-0253600686cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f41d86-6e39-4a02-aa12-0253600686cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dbbe0d6-9ac6-4228-a009-9906c0535ad6', 'volume_name': 'volume-5dbbe0d6-9ac6-4228-a009-9906c0535ad6', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f18059-f561-41f2-a9de-7b6e9f094757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f18059-f561-41f2-a9de-7b6e9f094757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efca4754-459d-4641-a1dd-86c5dfc79257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:43 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Volume 5dbbe0d6-9ac6-4228-a009-9906c0535ad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dbbe0d6-9ac6-4228-a009-9906c0535ad6', 'volume_size': 1} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:36:43 devstack sudo[111617]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c5f24fd9-4623-4549-a241-307d8e440ad3 1073741824" returned: 0 in 0.832s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c5f24fd9-4623-4549-a241-307d8e440ad3 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:43 devstack sudo[111623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c5f24fd9-4623-4549-a241-307d8e440ad3 Apr 29 17:36:43 devstack sudo[111623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Flow 'volume_create_manager' (4378a313-1931-42c0-b1a0-b253e989a912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3ce0a1-a542-4848-9d24-735a9df5d882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee3ce0a1-a542-4848-9d24-735a9df5d882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-503633394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b97f307-ac72-4f76-8cd9-8fa2ce5924b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8a530e01324aab870a99f24734b30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:36:44Z,use_quota=True,user_id='bae11a317b3545acadf1a3c81a4f0d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804f7331-8c83-43fe-9376-e7abfaa0c45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (804f7331-8c83-43fe-9376-e7abfaa0c45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc8da73-9812-4d5a-8ee4-99dff4b4eb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cc8da73-9812-4d5a-8ee4-99dff4b4eb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b97f307-ac72-4f76-8cd9-8fa2ce5924b4', 'volume_name': 'volume-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31728778-3ced-4862-ae99-2196fb6965ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31728778-3ced-4862-ae99-2196fb6965ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f594ef-5ca6-4856-875f-7670be9ad1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:43 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Volume 4b97f307-ac72-4f76-8cd9-8fa2ce5924b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4', 'volume_size': 1} Apr 29 17:36:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Flow 'volume_create_manager' (a78a759f-4e04-4236-bb04-f48bd054f236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b3b8c2-144a-422d-99fd-0fe592fab6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b3b8c2-144a-422d-99fd-0fe592fab6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095804829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf1b6e8-bfd3-4c59-95da-e0187a8ffeee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8a530e01324aab870a99f24734b30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:36:44Z,use_quota=True,user_id='bae11a317b3545acadf1a3c81a4f0d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6560ab-fc46-4242-92f7-d0e74dd395b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6560ab-fc46-4242-92f7-d0e74dd395b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6492f652-b2ed-467e-bec8-f4a83ab3c41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6492f652-b2ed-467e-bec8-f4a83ab3c41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caf1b6e8-bfd3-4c59-95da-e0187a8ffeee', 'volume_name': 'volume-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31de96b8-2d20-45eb-84d0-693147eba7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31de96b8-2d20-45eb-84d0-693147eba7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8753a3-07d3-4b8b-889c-9b90c34bc584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:44 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Volume caf1b6e8-bfd3-4c59-95da-e0187a8ffeee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee', 'volume_size': 1} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:36:44 devstack sudo[111623]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c5f24fd9-4623-4549-a241-307d8e440ad3" returned: 0 in 0.670s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.190s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-40863439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e07a736-0b59-42e8-89e6-7c90ac19a063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8a530e01324aab870a99f24734b30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:36:43Z,use_quota=True,user_id='bae11a317b3545acadf1a3c81a4f0d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Creating volume 4e07a736-0b59-42e8-89e6-7c90ac19a063 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:36:44 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e07a736-0b59-42e8-89e6-7c90ac19a063 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb28171d-89b1-425d-bce7-17fed6cda549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5f24fd9-4623-4549-a241-307d8e440ad3', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:44 devstack sudo[111626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e07a736-0b59-42e8-89e6-7c90ac19a063 1073741824 Apr 29 17:36:44 devstack sudo[111626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ff4f0e-8459-4041-ab4c-0b708fa100f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:44 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Volume volume-c5f24fd9-4623-4549-a241-307d8e440ad3 (c5f24fd9-4623-4549-a241-307d8e440ad3): created successfully Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ff4f0e-8459-4041-ab4c-0b708fa100f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Flow 'volume_create_manager' (41e582db-9709-4362-8bb5-b64c82ed99d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:36:44 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-b5f5eb7b-7731-45ff-a9ee-f4b93b0a6b24 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Created volume successfully. Apr 29 17:36:45 devstack sudo[111626]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e07a736-0b59-42e8-89e6-7c90ac19a063 1073741824" returned: 0 in 0.762s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e07a736-0b59-42e8-89e6-7c90ac19a063 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:45 devstack sudo[111632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e07a736-0b59-42e8-89e6-7c90ac19a063 Apr 29 17:36:45 devstack sudo[111632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:45 devstack sudo[111632]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e07a736-0b59-42e8-89e6-7c90ac19a063" returned: 0 in 0.580s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:36:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:36:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.257s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:36:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-443832772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dbbe0d6-9ac6-4228-a009-9906c0535ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8a530e01324aab870a99f24734b30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:36:43Z,use_quota=True,user_id='bae11a317b3545acadf1a3c81a4f0d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:36:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Creating volume 5dbbe0d6-9ac6-4228-a009-9906c0535ad6 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:36:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:36:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:36:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:36:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:36:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:36:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:36:45 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:36:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5dbbe0d6-9ac6-4228-a009-9906c0535ad6 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:45 devstack sudo[111635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5dbbe0d6-9ac6-4228-a009-9906c0535ad6 1073741824 Apr 29 17:36:45 devstack sudo[111635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (611ef449-6156-4722-97ba-9dd51245b72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e07a736-0b59-42e8-89e6-7c90ac19a063', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e41b2fd-8be3-4516-bbca-92cd93f9373b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:45 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Volume volume-4e07a736-0b59-42e8-89e6-7c90ac19a063 (4e07a736-0b59-42e8-89e6-7c90ac19a063): created successfully Apr 29 17:36:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e41b2fd-8be3-4516-bbca-92cd93f9373b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Flow 'volume_create_manager' (2cb614f5-a8a7-4b72-8e9a-6382ae60f0a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:36:45 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-b2fce241-0078-46bf-8a7e-2612a1422636 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Created volume successfully. Apr 29 17:36:46 devstack sudo[111635]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5dbbe0d6-9ac6-4228-a009-9906c0535ad6 1073741824" returned: 0 in 0.766s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5dbbe0d6-9ac6-4228-a009-9906c0535ad6 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:46 devstack sudo[111640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5dbbe0d6-9ac6-4228-a009-9906c0535ad6 Apr 29 17:36:46 devstack sudo[111640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:47 devstack sudo[111640]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5dbbe0d6-9ac6-4228-a009-9906c0535ad6" returned: 0 in 0.579s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:36:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:36:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.286s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:36:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-503633394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b97f307-ac72-4f76-8cd9-8fa2ce5924b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8a530e01324aab870a99f24734b30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:36:44Z,use_quota=True,user_id='bae11a317b3545acadf1a3c81a4f0d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:36:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Creating volume 4b97f307-ac72-4f76-8cd9-8fa2ce5924b4 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:36:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:36:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:36:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:36:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:36:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:36:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:36:47 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:36:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efca4754-459d-4641-a1dd-86c5dfc79257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dbbe0d6-9ac6-4228-a009-9906c0535ad6', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67c9ba3-e639-4a64-9db9-e7dcaa6c50e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:47 devstack sudo[111644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4 1073741824 Apr 29 17:36:47 devstack sudo[111644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:47 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Volume volume-5dbbe0d6-9ac6-4228-a009-9906c0535ad6 (5dbbe0d6-9ac6-4228-a009-9906c0535ad6): created successfully Apr 29 17:36:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67c9ba3-e639-4a64-9db9-e7dcaa6c50e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Flow 'volume_create_manager' (4a10a28c-1dc7-418d-889e-1339341e6c78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:36:47 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-20266bec-7903-44a1-87d5-79ce20f50c34 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Created volume successfully. Apr 29 17:36:47 devstack sudo[111644]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4 1073741824" returned: 0 in 0.776s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:47 devstack sudo[111649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4 Apr 29 17:36:47 devstack sudo[111649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:48 devstack sudo[111649]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4" returned: 0 in 0.636s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:36:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:36:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.455s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:36:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:36:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095804829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf1b6e8-bfd3-4c59-95da-e0187a8ffeee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab8a530e01324aab870a99f24734b30d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:36:44Z,use_quota=True,user_id='bae11a317b3545acadf1a3c81a4f0d1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:36:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Creating volume caf1b6e8-bfd3-4c59-95da-e0187a8ffeee {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:36:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:36:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:36:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:36:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:36:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:36:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:36:48 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:36:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f594ef-5ca6-4856-875f-7670be9ad1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:48 devstack sudo[111652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee 1073741824 Apr 29 17:36:48 devstack sudo[111652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0583922b-9187-4b28-a9ba-384fe31bd34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:48 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Volume volume-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4 (4b97f307-ac72-4f76-8cd9-8fa2ce5924b4): created successfully Apr 29 17:36:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0583922b-9187-4b28-a9ba-384fe31bd34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Flow 'volume_create_manager' (4378a313-1931-42c0-b1a0-b253e989a912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:36:48 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-44841e06-aa7c-46f7-b881-19e0ec30a482 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Created volume successfully. Apr 29 17:36:49 devstack sudo[111652]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee 1073741824" returned: 0 in 0.762s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:49 devstack sudo[111658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee Apr 29 17:36:49 devstack sudo[111658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:49 devstack sudo[111658]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee" returned: 0 in 0.578s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:49 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:36:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:36:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8753a3-07d3-4b8b-889c-9b90c34bc584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d20da8-2c60-477a-9863-62872a0b5daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:36:50 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Volume volume-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee (caf1b6e8-bfd3-4c59-95da-e0187a8ffeee): created successfully Apr 29 17:36:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d20da8-2c60-477a-9863-62872a0b5daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:36:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Flow 'volume_create_manager' (a78a759f-4e04-4236-bb04-f48bd054f236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:36:50 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-c1a8c7f3-d2d3-4558-8ef1-46c4ac26237c tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Created volume successfully. Apr 29 17:36:50 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4f92216a-6b1a-4ae4-8790-01f78c4330a0 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "cinder-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:36:50 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4f92216a-6b1a-4ae4-8790-01f78c4330a0 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:36:50 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4f92216a-6b1a-4ae4-8790-01f78c4330a0 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "cinder-quobyte-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:36:50 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4f92216a-6b1a-4ae4-8790-01f78c4330a0 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-quobyte-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee" acquired by "delete_volume" :: waited 0.014s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:36:50 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd443e8-8e56-4177-8fa6-547f42df800b]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:36:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4f92216a-6b1a-4ae4-8790-01f78c4330a0 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:50 devstack sudo[111661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee Apr 29 17:36:50 devstack sudo[111661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:51 devstack sudo[111661]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4f92216a-6b1a-4ae4-8790-01f78c4330a0 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee" returned: 0 in 0.684s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4f92216a-6b1a-4ae4-8790-01f78c4330a0 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:51 devstack sudo[111666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee Apr 29 17:36:51 devstack sudo[111666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:51 devstack sudo[111666]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4f92216a-6b1a-4ae4-8790-01f78c4330a0 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee" returned: 0 in 0.579s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4f92216a-6b1a-4ae4-8790-01f78c4330a0 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-quobyte-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee" released by "delete_volume" :: held 1.305s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:36:52 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-4f92216a-6b1a-4ae4-8790-01f78c4330a0 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Created reservations ['976f7902-8574-406b-afb0-4f0875fd07c9', '931eccb5-6f08-429e-9a63-9260267577b1', '7856aa85-38d2-4c0c-b47f-f7b9ab2509f7', 'afb524cf-ab70-473a-b99f-310350b5ebd4'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:36:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4f92216a-6b1a-4ae4-8790-01f78c4330a0 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:36:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4f92216a-6b1a-4ae4-8790-01f78c4330a0 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:36:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4f92216a-6b1a-4ae4-8790-01f78c4330a0 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:36:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4f92216a-6b1a-4ae4-8790-01f78c4330a0 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:36:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4f92216a-6b1a-4ae4-8790-01f78c4330a0 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:36:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4f92216a-6b1a-4ae4-8790-01f78c4330a0 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:52 devstack sudo[111669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:36:52 devstack sudo[111669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:52 devstack sudo[111669]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4f92216a-6b1a-4ae4-8790-01f78c4330a0 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.579s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:52 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-4f92216a-6b1a-4ae4-8790-01f78c4330a0 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:36:52 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4f92216a-6b1a-4ae4-8790-01f78c4330a0 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Deleted volume successfully. Apr 29 17:36:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4f92216a-6b1a-4ae4-8790-01f78c4330a0 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-caf1b6e8-bfd3-4c59-95da-e0187a8ffeee-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:36:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-bc23006e-d274-4a26-b3e6-b7ba18bba755 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "cinder-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:36:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-bc23006e-d274-4a26-b3e6-b7ba18bba755 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:36:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-bc23006e-d274-4a26-b3e6-b7ba18bba755 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "cinder-quobyte-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:36:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-bc23006e-d274-4a26-b3e6-b7ba18bba755 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-quobyte-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4" acquired by "delete_volume" :: waited 0.013s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:36:52 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[639914d3-6bbf-4695-b6c2-11762347f769]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:36:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bc23006e-d274-4a26-b3e6-b7ba18bba755 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:53 devstack sudo[111672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4 Apr 29 17:36:53 devstack sudo[111672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:53 devstack sudo[111672]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bc23006e-d274-4a26-b3e6-b7ba18bba755 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4" returned: 0 in 0.691s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bc23006e-d274-4a26-b3e6-b7ba18bba755 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:53 devstack sudo[111677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4 Apr 29 17:36:53 devstack sudo[111677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:54 devstack sudo[111677]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bc23006e-d274-4a26-b3e6-b7ba18bba755 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4" returned: 0 in 0.590s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-bc23006e-d274-4a26-b3e6-b7ba18bba755 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-quobyte-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4" released by "delete_volume" :: held 1.320s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:36:54 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-bc23006e-d274-4a26-b3e6-b7ba18bba755 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Created reservations ['38c1fb00-d686-495d-8472-150959510985', '949fe2fc-fde1-4f03-b29e-bde2afe324a4', '6cb314a6-3388-4d9e-a8e6-ff18ca0411d5', '3fcd8b6c-86d0-4a89-81a2-605d403f2118'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:36:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bc23006e-d274-4a26-b3e6-b7ba18bba755 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:36:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bc23006e-d274-4a26-b3e6-b7ba18bba755 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:36:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-bc23006e-d274-4a26-b3e6-b7ba18bba755 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:36:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-bc23006e-d274-4a26-b3e6-b7ba18bba755 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:36:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bc23006e-d274-4a26-b3e6-b7ba18bba755 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:36:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bc23006e-d274-4a26-b3e6-b7ba18bba755 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:54 devstack sudo[111680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:36:54 devstack sudo[111680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:54 devstack sudo[111680]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bc23006e-d274-4a26-b3e6-b7ba18bba755 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.582s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:54 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-bc23006e-d274-4a26-b3e6-b7ba18bba755 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:36:54 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-bc23006e-d274-4a26-b3e6-b7ba18bba755 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Deleted volume successfully. Apr 29 17:36:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-bc23006e-d274-4a26-b3e6-b7ba18bba755 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-4b97f307-ac72-4f76-8cd9-8fa2ce5924b4-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:36:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9216cb16-3a53-425c-9dd7-33f59ccf4163 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "cinder-5dbbe0d6-9ac6-4228-a009-9906c0535ad6-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:36:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9216cb16-3a53-425c-9dd7-33f59ccf4163 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-5dbbe0d6-9ac6-4228-a009-9906c0535ad6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:36:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9216cb16-3a53-425c-9dd7-33f59ccf4163 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "cinder-quobyte-5dbbe0d6-9ac6-4228-a009-9906c0535ad6" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:36:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9216cb16-3a53-425c-9dd7-33f59ccf4163 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-quobyte-5dbbe0d6-9ac6-4228-a009-9906c0535ad6" acquired by "delete_volume" :: waited 0.015s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:36:55 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2f846a-b9fa-4359-bc8c-3d339add714c]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:36:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9216cb16-3a53-425c-9dd7-33f59ccf4163 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5dbbe0d6-9ac6-4228-a009-9906c0535ad6 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:55 devstack sudo[111683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5dbbe0d6-9ac6-4228-a009-9906c0535ad6 Apr 29 17:36:55 devstack sudo[111683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:55 devstack sudo[111683]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9216cb16-3a53-425c-9dd7-33f59ccf4163 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5dbbe0d6-9ac6-4228-a009-9906c0535ad6" returned: 0 in 0.699s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9216cb16-3a53-425c-9dd7-33f59ccf4163 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5dbbe0d6-9ac6-4228-a009-9906c0535ad6 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:55 devstack sudo[111688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5dbbe0d6-9ac6-4228-a009-9906c0535ad6 Apr 29 17:36:55 devstack sudo[111688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:56 devstack sudo[111688]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9216cb16-3a53-425c-9dd7-33f59ccf4163 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5dbbe0d6-9ac6-4228-a009-9906c0535ad6" returned: 0 in 0.588s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9216cb16-3a53-425c-9dd7-33f59ccf4163 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-quobyte-5dbbe0d6-9ac6-4228-a009-9906c0535ad6" released by "delete_volume" :: held 1.325s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:36:56 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-9216cb16-3a53-425c-9dd7-33f59ccf4163 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Created reservations ['5aa7a374-00bd-4015-9c7b-71fd756af874', 'ad027f00-6bd0-493d-9822-46c74cef29fa', '9ac89502-2455-495d-aacf-b98965be36f1', '956f28b2-483b-4613-bd14-cc7b0b3c8db1'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:36:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9216cb16-3a53-425c-9dd7-33f59ccf4163 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:36:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9216cb16-3a53-425c-9dd7-33f59ccf4163 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:36:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9216cb16-3a53-425c-9dd7-33f59ccf4163 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:36:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9216cb16-3a53-425c-9dd7-33f59ccf4163 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:36:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9216cb16-3a53-425c-9dd7-33f59ccf4163 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:36:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9216cb16-3a53-425c-9dd7-33f59ccf4163 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:56 devstack sudo[111692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:36:56 devstack sudo[111692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:57 devstack sudo[111692]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9216cb16-3a53-425c-9dd7-33f59ccf4163 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.601s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:57 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-9216cb16-3a53-425c-9dd7-33f59ccf4163 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:36:57 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-9216cb16-3a53-425c-9dd7-33f59ccf4163 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Deleted volume successfully. Apr 29 17:36:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-9216cb16-3a53-425c-9dd7-33f59ccf4163 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-5dbbe0d6-9ac6-4228-a009-9906c0535ad6-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:36:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-771d0459-8f77-410d-bc9f-0bdbf11a1072 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "cinder-4e07a736-0b59-42e8-89e6-7c90ac19a063-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:36:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-771d0459-8f77-410d-bc9f-0bdbf11a1072 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-4e07a736-0b59-42e8-89e6-7c90ac19a063-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:36:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-771d0459-8f77-410d-bc9f-0bdbf11a1072 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "cinder-quobyte-4e07a736-0b59-42e8-89e6-7c90ac19a063" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:36:57 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-771d0459-8f77-410d-bc9f-0bdbf11a1072 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-quobyte-4e07a736-0b59-42e8-89e6-7c90ac19a063" acquired by "delete_volume" :: waited 0.014s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:36:57 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6efabb-5951-4ee8-8596-8cdcb5583a7a]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:36:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-771d0459-8f77-410d-bc9f-0bdbf11a1072 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e07a736-0b59-42e8-89e6-7c90ac19a063 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:57 devstack sudo[111696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e07a736-0b59-42e8-89e6-7c90ac19a063 Apr 29 17:36:57 devstack sudo[111696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:58 devstack sudo[111696]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-771d0459-8f77-410d-bc9f-0bdbf11a1072 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e07a736-0b59-42e8-89e6-7c90ac19a063" returned: 0 in 0.693s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-771d0459-8f77-410d-bc9f-0bdbf11a1072 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e07a736-0b59-42e8-89e6-7c90ac19a063 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:58 devstack sudo[111701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e07a736-0b59-42e8-89e6-7c90ac19a063 Apr 29 17:36:58 devstack sudo[111701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:58 devstack sudo[111701]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-771d0459-8f77-410d-bc9f-0bdbf11a1072 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4e07a736-0b59-42e8-89e6-7c90ac19a063" returned: 0 in 0.588s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-771d0459-8f77-410d-bc9f-0bdbf11a1072 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-quobyte-4e07a736-0b59-42e8-89e6-7c90ac19a063" released by "delete_volume" :: held 1.320s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:36:58 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-771d0459-8f77-410d-bc9f-0bdbf11a1072 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Created reservations ['75b2a91b-33b1-455c-a05e-67f2a99985bc', '37fb50b0-9c68-4309-b989-0277bd92c914', '991a7f48-4168-4b6b-9988-219b5052424b', 'c810c285-984f-4ccb-b996-000d47a9112a'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:36:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-771d0459-8f77-410d-bc9f-0bdbf11a1072 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:36:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-771d0459-8f77-410d-bc9f-0bdbf11a1072 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:36:58 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-771d0459-8f77-410d-bc9f-0bdbf11a1072 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:36:58 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-771d0459-8f77-410d-bc9f-0bdbf11a1072 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:36:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-771d0459-8f77-410d-bc9f-0bdbf11a1072 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:36:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-771d0459-8f77-410d-bc9f-0bdbf11a1072 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:58 devstack sudo[111704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:36:58 devstack sudo[111704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:36:59 devstack sudo[111704]: pam_unix(sudo:session): session closed for user root Apr 29 17:36:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-771d0459-8f77-410d-bc9f-0bdbf11a1072 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.583s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:36:59 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-771d0459-8f77-410d-bc9f-0bdbf11a1072 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:36:59 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-771d0459-8f77-410d-bc9f-0bdbf11a1072 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Deleted volume successfully. Apr 29 17:36:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-771d0459-8f77-410d-bc9f-0bdbf11a1072 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-4e07a736-0b59-42e8-89e6-7c90ac19a063-delete_volume" released by "delete_volume" :: held 2.089s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:36:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f4ac1580-3b12-43c3-89a0-c0d415fa9948 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "cinder-c5f24fd9-4623-4549-a241-307d8e440ad3-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:36:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f4ac1580-3b12-43c3-89a0-c0d415fa9948 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-c5f24fd9-4623-4549-a241-307d8e440ad3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:36:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f4ac1580-3b12-43c3-89a0-c0d415fa9948 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "cinder-quobyte-c5f24fd9-4623-4549-a241-307d8e440ad3" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:36:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f4ac1580-3b12-43c3-89a0-c0d415fa9948 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-quobyte-c5f24fd9-4623-4549-a241-307d8e440ad3" acquired by "delete_volume" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:36:59 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[3297b843-22e2-4441-8e10-b14287ffc0b0]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:36:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f4ac1580-3b12-43c3-89a0-c0d415fa9948 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c5f24fd9-4623-4549-a241-307d8e440ad3 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:36:59 devstack sudo[111709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c5f24fd9-4623-4549-a241-307d8e440ad3 Apr 29 17:36:59 devstack sudo[111709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:00 devstack sudo[111709]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f4ac1580-3b12-43c3-89a0-c0d415fa9948 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c5f24fd9-4623-4549-a241-307d8e440ad3" returned: 0 in 0.712s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f4ac1580-3b12-43c3-89a0-c0d415fa9948 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c5f24fd9-4623-4549-a241-307d8e440ad3 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:00 devstack sudo[111714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c5f24fd9-4623-4549-a241-307d8e440ad3 Apr 29 17:37:00 devstack sudo[111714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:00 devstack sudo[111714]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f4ac1580-3b12-43c3-89a0-c0d415fa9948 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c5f24fd9-4623-4549-a241-307d8e440ad3" returned: 0 in 0.580s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f4ac1580-3b12-43c3-89a0-c0d415fa9948 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-quobyte-c5f24fd9-4623-4549-a241-307d8e440ad3" released by "delete_volume" :: held 1.331s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:37:00 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-f4ac1580-3b12-43c3-89a0-c0d415fa9948 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Created reservations ['9e63a972-72ed-4b13-a598-74f7c40c3bf0', '2f0f3e6f-0de9-48e3-85ea-c3e3dd9525a8', 'b5875557-f5a3-4eac-8f46-96b438d8d375', '3dbb8c24-b17c-4d37-a968-0ba41733c07c'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:37:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f4ac1580-3b12-43c3-89a0-c0d415fa9948 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f4ac1580-3b12-43c3-89a0-c0d415fa9948 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f4ac1580-3b12-43c3-89a0-c0d415fa9948 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:37:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f4ac1580-3b12-43c3-89a0-c0d415fa9948 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:37:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f4ac1580-3b12-43c3-89a0-c0d415fa9948 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f4ac1580-3b12-43c3-89a0-c0d415fa9948 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:00 devstack sudo[111717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:37:00 devstack sudo[111717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:01 devstack sudo[111717]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f4ac1580-3b12-43c3-89a0-c0d415fa9948 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.585s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:01 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-f4ac1580-3b12-43c3-89a0-c0d415fa9948 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:37:01 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f4ac1580-3b12-43c3-89a0-c0d415fa9948 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Deleted volume successfully. Apr 29 17:37:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f4ac1580-3b12-43c3-89a0-c0d415fa9948 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-c5f24fd9-4623-4549-a241-307d8e440ad3-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:37:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-97b5aa25-7e17-45b2-aa4b-ded4c8cb36e6 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "cinder-74bf5d5b-c16c-468f-b385-bfbf48e3810c-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:37:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-97b5aa25-7e17-45b2-aa4b-ded4c8cb36e6 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-74bf5d5b-c16c-468f-b385-bfbf48e3810c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:37:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-97b5aa25-7e17-45b2-aa4b-ded4c8cb36e6 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "cinder-quobyte-74bf5d5b-c16c-468f-b385-bfbf48e3810c" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:37:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-97b5aa25-7e17-45b2-aa4b-ded4c8cb36e6 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-quobyte-74bf5d5b-c16c-468f-b385-bfbf48e3810c" acquired by "delete_volume" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:37:01 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[a991f0d1-c8d5-4d9b-b921-3041d86cebb6]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:37:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-97b5aa25-7e17-45b2-aa4b-ded4c8cb36e6 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74bf5d5b-c16c-468f-b385-bfbf48e3810c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:01 devstack sudo[111721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74bf5d5b-c16c-468f-b385-bfbf48e3810c Apr 29 17:37:01 devstack sudo[111721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:02 devstack sudo[111721]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-97b5aa25-7e17-45b2-aa4b-ded4c8cb36e6 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74bf5d5b-c16c-468f-b385-bfbf48e3810c" returned: 0 in 0.691s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-97b5aa25-7e17-45b2-aa4b-ded4c8cb36e6 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74bf5d5b-c16c-468f-b385-bfbf48e3810c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:02 devstack sudo[111726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74bf5d5b-c16c-468f-b385-bfbf48e3810c Apr 29 17:37:02 devstack sudo[111726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:03 devstack sudo[111726]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-97b5aa25-7e17-45b2-aa4b-ded4c8cb36e6 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-74bf5d5b-c16c-468f-b385-bfbf48e3810c" returned: 0 in 0.586s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-97b5aa25-7e17-45b2-aa4b-ded4c8cb36e6 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-quobyte-74bf5d5b-c16c-468f-b385-bfbf48e3810c" released by "delete_volume" :: held 1.315s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:37:03 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-97b5aa25-7e17-45b2-aa4b-ded4c8cb36e6 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Created reservations ['7c99e158-3618-4bfc-833c-3845fa22252c', '3f626bba-0e3d-4ec3-86a1-9b746de13161', 'b630b134-7b42-4d46-9706-a6f5ea44031e', '62361cdc-b1a3-409d-8a88-113c17097b9a'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:37:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97b5aa25-7e17-45b2-aa4b-ded4c8cb36e6 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97b5aa25-7e17-45b2-aa4b-ded4c8cb36e6 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-97b5aa25-7e17-45b2-aa4b-ded4c8cb36e6 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:37:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-97b5aa25-7e17-45b2-aa4b-ded4c8cb36e6 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:37:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-97b5aa25-7e17-45b2-aa4b-ded4c8cb36e6 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-97b5aa25-7e17-45b2-aa4b-ded4c8cb36e6 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:03 devstack sudo[111729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:37:03 devstack sudo[111729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:03 devstack sudo[111729]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-97b5aa25-7e17-45b2-aa4b-ded4c8cb36e6 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.619s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:03 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-97b5aa25-7e17-45b2-aa4b-ded4c8cb36e6 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:37:03 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-97b5aa25-7e17-45b2-aa4b-ded4c8cb36e6 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Deleted volume successfully. Apr 29 17:37:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-97b5aa25-7e17-45b2-aa4b-ded4c8cb36e6 tempest-CreateVolumesFromSourceVolumeTest-1574565124 None] Lock "cinder-74bf5d5b-c16c-468f-b385-bfbf48e3810c-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:37:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:37:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:37:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:37:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:05 devstack sudo[111733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:37:05 devstack sudo[111733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:06 devstack sudo[111733]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.598s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Flow 'volume_create_manager' (63ac5084-9da6-41f9-b215-88babf3a3be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a5f694-a5d3-438d-a5cd-0a0ff875a75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a5f694-a5d3-438d-a5cd-0a0ff875a75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1625864335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b2f2f6-9b45-4d2e-b438-4a24d43c3953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d099241fba48939cfd2059fd17247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:37:06Z,use_quota=True,user_id='49e2ec475c27427c860a96a339b0e8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e70416-b680-4f82-8812-82a3a00cea60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e70416-b680-4f82-8812-82a3a00cea60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0649c94b-deae-41a8-b04c-4daa7f7a9cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0649c94b-deae-41a8-b04c-4daa7f7a9cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0b2f2f6-9b45-4d2e-b438-4a24d43c3953', 'volume_name': 'volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7faeb5aa-33bb-486c-8759-e120362b5241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7faeb5aa-33bb-486c-8759-e120362b5241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d8b789-49df-4f79-bbd5-fd94c86018f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:06 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Volume c0b2f2f6-9b45-4d2e-b438-4a24d43c3953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953', 'volume_size': 1} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1625864335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b2f2f6-9b45-4d2e-b438-4a24d43c3953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d099241fba48939cfd2059fd17247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:37:06Z,use_quota=True,user_id='49e2ec475c27427c860a96a339b0e8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Creating volume c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:37:06 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:37:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:06 devstack sudo[111736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 1073741824 Apr 29 17:37:06 devstack sudo[111736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:07 devstack sudo[111736]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 1073741824" returned: 0 in 0.753s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:07 devstack sudo[111779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 Apr 29 17:37:07 devstack sudo[111779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:07 devstack sudo[111779]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953" returned: 0 in 0.574s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:37:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96d8b789-49df-4f79-bbd5-fd94c86018f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec447b7-8e09-4a5b-8602-2d398c5dd452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:07 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Volume volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 (c0b2f2f6-9b45-4d2e-b438-4a24d43c3953): created successfully Apr 29 17:37:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec447b7-8e09-4a5b-8602-2d398c5dd452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Flow 'volume_create_manager' (63ac5084-9da6-41f9-b215-88babf3a3be3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:37:07 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-a61f5d9c-5d28-4a64-aaf7-42f580a93088 tempest-VolumeDependencyTests-194956577 None] Created volume successfully. Apr 29 17:37:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-27679062-59eb-47ce-be16-c652522587a0 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-27679062-59eb-47ce-be16-c652522587a0 tempest-VolumeDependencyTests-194956577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-27679062-59eb-47ce-be16-c652522587a0 tempest-VolumeDependencyTests-194956577 None] Creating offline snapshot 4f8ae74f-3499-4195-adac-ce29902c1eb8 of volume c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:37:08 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbbeeb4-a222-4eb0-860e-b894ad52bd9d]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:37:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-27679062-59eb-47ce-be16-c652522587a0 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:08 devstack sudo[111788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 Apr 29 17:37:08 devstack sudo[111788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:09 devstack sudo[111788]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-27679062-59eb-47ce-be16-c652522587a0 tempest-VolumeDependencyTests-194956577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953" returned: 0 in 0.728s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-27679062-59eb-47ce-be16-c652522587a0 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:09 devstack sudo[111794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8 1G Apr 29 17:37:09 devstack sudo[111794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:10 devstack sudo[111794]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-27679062-59eb-47ce-be16-c652522587a0 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8 1G" returned: 0 in 0.706s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-27679062-59eb-47ce-be16-c652522587a0 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:10 devstack sudo[111801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8 Apr 29 17:37:10 devstack sudo[111801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:10 devstack sudo[111801]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-27679062-59eb-47ce-be16-c652522587a0 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8" returned: 0 in 0.638s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:10 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-27679062-59eb-47ce-be16-c652522587a0 tempest-VolumeDependencyTests-194956577 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8 is being set with open permissions: ugo+rw Apr 29 17:37:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-27679062-59eb-47ce-be16-c652522587a0 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:10 devstack sudo[111807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8 Apr 29 17:37:10 devstack sudo[111807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:11 devstack sudo[111807]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-27679062-59eb-47ce-be16-c652522587a0 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8" returned: 0 in 0.576s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-27679062-59eb-47ce-be16-c652522587a0 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:11 devstack sudo[111810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.info Apr 29 17:37:11 devstack sudo[111810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:11 devstack sudo[111810]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-27679062-59eb-47ce-be16-c652522587a0 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.info" returned: 0 in 0.584s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:11 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-27679062-59eb-47ce-be16-c652522587a0 tempest-VolumeDependencyTests-194956577 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.info is being set with open permissions: ugo+rw Apr 29 17:37:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-27679062-59eb-47ce-be16-c652522587a0 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:11 devstack sudo[111813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.info Apr 29 17:37:11 devstack sudo[111813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:12 devstack sudo[111813]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-27679062-59eb-47ce-be16-c652522587a0 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.info" returned: 0 in 0.583s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-27679062-59eb-47ce-be16-c652522587a0 tempest-VolumeDependencyTests-194956577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.896s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:12 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-27679062-59eb-47ce-be16-c652522587a0 tempest-VolumeDependencyTests-194956577 None] Create snapshot completed successfully Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Flow 'volume_create_manager' (5de64b26-7c3e-4af3-aa29-5377ae853986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442e4c69-2d7f-4faa-88c2-95fe32f9dc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442e4c69-2d7f-4faa-88c2-95fe32f9dc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1094832503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d59875-d680-4140-bb80-5d27c7f6eefc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d099241fba48939cfd2059fd17247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4f8ae74f-3499-4195-adac-ce29902c1eb8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:37:13Z,use_quota=True,user_id='49e2ec475c27427c860a96a339b0e8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889fe4db-87dc-48de-a7bc-69f4cd1fe215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (889fe4db-87dc-48de-a7bc-69f4cd1fe215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da279aa-76a1-48d6-8c72-ae8ffc0b4f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da279aa-76a1-48d6-8c72-ae8ffc0b4f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '34d59875-d680-4140-bb80-5d27c7f6eefc', 'volume_name': 'volume-34d59875-d680-4140-bb80-5d27c7f6eefc', 'volume_size': 1, 'snapshot_id': '4f8ae74f-3499-4195-adac-ce29902c1eb8'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49337ed0-679c-4844-adf8-8f595c19aebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49337ed0-679c-4844-adf8-8f595c19aebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62982549-adf3-4a99-b0c8-5725da51905a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:13 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Volume 34d59875-d680-4140-bb80-5d27c7f6eefc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-34d59875-d680-4140-bb80-5d27c7f6eefc', 'volume_size': 1, 'snapshot_id': '4f8ae74f-3499-4195-adac-ce29902c1eb8'} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Acquiring lock "cinder-quobyte-4f8ae74f-3499-4195-adac-ce29902c1eb8-34d59875-d680-4140-bb80-5d27c7f6eefc" by "_create_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Lock "cinder-quobyte-4f8ae74f-3499-4195-adac-ce29902c1eb8-34d59875-d680-4140-bb80-5d27c7f6eefc" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Creating volume 34d59875-d680-4140-bb80-5d27c7f6eefc from snapshot 4f8ae74f-3499-4195-adac-ce29902c1eb8 {{(pid=84547) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Acquiring lock "cinder-quobyte-34d59875-d680-4140-bb80-5d27c7f6eefc" by "_copy_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Lock "cinder-quobyte-34d59875-d680-4140-bb80-5d27c7f6eefc" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] snapshot: 4f8ae74f-3499-4195-adac-ce29902c1eb8, volume: 34d59875-d680-4140-bb80-5d27c7f6eefc, {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26cd2ca-194d-4c13-88e8-4bd0982b251a]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:37:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:13 devstack sudo[111816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8 Apr 29 17:37:13 devstack sudo[111816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:14 devstack sudo[111816]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8" returned: 0 in 0.697s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:37:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 17:37:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Creating direct copy from snapshot {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 17:37:14 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ef7bcb-137b-411a-a8cd-7181ce870690]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:37:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:14 devstack sudo[111821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 Apr 29 17:37:14 devstack sudo[111821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:14 devstack sudo[111821]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953" returned: 0 in 0.697s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:14 devstack cinder-volume[84547]: DEBUG cinder.utils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Path /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34d59875-d680-4140-bb80-5d27c7f6eefc not found in is_blk_device check {{(pid=84547) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 17:37:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34d59875-d680-4140-bb80-5d27c7f6eefc {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:14 devstack sudo[111826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34d59875-d680-4140-bb80-5d27c7f6eefc Apr 29 17:37:14 devstack sudo[111826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:19 devstack sudo[111826]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34d59875-d680-4140-bb80-5d27c7f6eefc" returned: 0 in 4.286s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:19 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73bd4ba-8d24-427f-a339-4251de2b2bc5]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:37:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:19 devstack sudo[111840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 Apr 29 17:37:19 devstack sudo[111840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:19 devstack sudo[111840]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953" returned: 0 in 0.869s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:19 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953, size 1024.00 MB, duration 4.29 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34d59875-d680-4140-bb80-5d27c7f6eefc {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:37:19 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Converted 1024.00 MB image at 238.83 MB/s Apr 29 17:37:19 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34d59875-d680-4140-bb80-5d27c7f6eefc is being set with open permissions: ugo+rw Apr 29 17:37:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34d59875-d680-4140-bb80-5d27c7f6eefc {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:19 devstack sudo[111845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34d59875-d680-4140-bb80-5d27c7f6eefc Apr 29 17:37:19 devstack sudo[111845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:20 devstack sudo[111845]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34d59875-d680-4140-bb80-5d27c7f6eefc" returned: 0 in 0.576s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Lock "cinder-quobyte-34d59875-d680-4140-bb80-5d27c7f6eefc" released by "_copy_volume_from_snapshot" :: held 7.210s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:37:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Lock "cinder-quobyte-4f8ae74f-3499-4195-adac-ce29902c1eb8-34d59875-d680-4140-bb80-5d27c7f6eefc" released by "_create_volume_from_snapshot" :: held 7.235s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:37:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.248s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62982549-adf3-4a99-b0c8-5725da51905a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34d59875-d680-4140-bb80-5d27c7f6eefc', 'volume_size': 1, 'snapshot_id': '4f8ae74f-3499-4195-adac-ce29902c1eb8'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4394e73-99e2-4767-8769-47d7558f4475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:20 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Volume volume-34d59875-d680-4140-bb80-5d27c7f6eefc (34d59875-d680-4140-bb80-5d27c7f6eefc): created successfully Apr 29 17:37:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4394e73-99e2-4767-8769-47d7558f4475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:20 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Flow 'volume_create_manager' (5de64b26-7c3e-4af3-aa29-5377ae853986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:37:20 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ec088a67-8ba3-42d5-ab75-c40671fe50be tempest-VolumeDependencyTests-194956577 None] Created volume successfully. Apr 29 17:37:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "cinder-4f8ae74f-3499-4195-adac-ce29902c1eb8-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:37:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-4f8ae74f-3499-4195-adac-ce29902c1eb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:37:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "cinder-quobyte-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:37:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-quobyte-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:37:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "cinder-quobyte-4f8ae74f-3499-4195-adac-ce29902c1eb8" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:37:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-quobyte-4f8ae74f-3499-4195-adac-ce29902c1eb8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:37:20 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] Deleting offline snapshot 4f8ae74f-3499-4195-adac-ce29902c1eb8 of volume c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:37:20 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] snapshot_file for this snap is: volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:37:20 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[727d5e7c-c3f5-4926-beea-2c131ec75a2f]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:37:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:20 devstack sudo[111848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8 Apr 29 17:37:20 devstack sudo[111848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:21 devstack sudo[111848]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8" returned: 0 in 0.663s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:37:21 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3d1fe7-b597-454f-8122-52284da31ae8]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:37:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:21 devstack sudo[111853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 Apr 29 17:37:21 devstack sudo[111853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:22 devstack sudo[111853]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953" returned: 0 in 0.678s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:22 devstack sudo[111858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8 Apr 29 17:37:22 devstack sudo[111858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:22 devstack sudo[111858]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8" returned: 0 in 0.667s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:22 devstack sudo[111863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8 Apr 29 17:37:22 devstack sudo[111863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:23 devstack sudo[111863]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953.4f8ae74f-3499-4195-adac-ce29902c1eb8" returned: 0 in 0.580s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-quobyte-4f8ae74f-3499-4195-adac-ce29902c1eb8" released by "_delete_snapshot" :: held 2.677s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:37:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-quobyte-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953" released by "delete_snapshot" :: held 2.700s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:37:23 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] Created reservations ['d7df345b-6ff9-4ea8-8e02-69d7c3869e94', '592e6b64-faca-4681-a137-459ddaee6571', '4cb90128-ddba-4f53-9410-50d056838f35', '9195234d-117e-497c-aa45-8c9b25343e92'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:37:23 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] Delete snapshot completed successfully. Apr 29 17:37:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f584150c-60ee-46ea-8b2c-909c272e8184 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-4f8ae74f-3499-4195-adac-ce29902c1eb8-delete_snapshot" released by "delete_snapshot" :: held 2.821s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:37:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d36fff37-bbfd-4535-82b0-dec0f2d74cde tempest-VolumeDependencyTests-194956577 None] Acquiring lock "cinder-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:37:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d36fff37-bbfd-4535-82b0-dec0f2d74cde tempest-VolumeDependencyTests-194956577 None] Lock "cinder-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:37:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d36fff37-bbfd-4535-82b0-dec0f2d74cde tempest-VolumeDependencyTests-194956577 None] Acquiring lock "cinder-quobyte-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:37:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d36fff37-bbfd-4535-82b0-dec0f2d74cde tempest-VolumeDependencyTests-194956577 None] Lock "cinder-quobyte-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953" acquired by "delete_volume" :: waited 0.014s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:37:24 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab833263-62dc-4075-a2da-96605b555840]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:37:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d36fff37-bbfd-4535-82b0-dec0f2d74cde tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:24 devstack sudo[111866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 Apr 29 17:37:24 devstack sudo[111866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:24 devstack sudo[111866]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d36fff37-bbfd-4535-82b0-dec0f2d74cde tempest-VolumeDependencyTests-194956577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953" returned: 0 in 0.675s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d36fff37-bbfd-4535-82b0-dec0f2d74cde tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:24 devstack sudo[111871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953 Apr 29 17:37:24 devstack sudo[111871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:25 devstack sudo[111871]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d36fff37-bbfd-4535-82b0-dec0f2d74cde tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953" returned: 0 in 0.577s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d36fff37-bbfd-4535-82b0-dec0f2d74cde tempest-VolumeDependencyTests-194956577 None] Lock "cinder-quobyte-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953" released by "delete_volume" :: held 1.302s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:37:25 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-d36fff37-bbfd-4535-82b0-dec0f2d74cde tempest-VolumeDependencyTests-194956577 None] Created reservations ['1157d6dc-4608-433d-8ec0-8668d26bcc7e', '0f9ee6d9-bfe9-4df0-a3cf-79728a248f86', 'b39d7539-bccb-4a07-a330-b7d2f9cd778e', '23be92ae-f760-4b36-b9bf-8ed836a0ec58'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:37:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d36fff37-bbfd-4535-82b0-dec0f2d74cde tempest-VolumeDependencyTests-194956577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d36fff37-bbfd-4535-82b0-dec0f2d74cde tempest-VolumeDependencyTests-194956577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:25 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d36fff37-bbfd-4535-82b0-dec0f2d74cde tempest-VolumeDependencyTests-194956577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:37:25 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d36fff37-bbfd-4535-82b0-dec0f2d74cde tempest-VolumeDependencyTests-194956577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:37:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d36fff37-bbfd-4535-82b0-dec0f2d74cde tempest-VolumeDependencyTests-194956577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d36fff37-bbfd-4535-82b0-dec0f2d74cde tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:25 devstack sudo[111874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:37:25 devstack sudo[111874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:25 devstack sudo[111874]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d36fff37-bbfd-4535-82b0-dec0f2d74cde tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.573s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:25 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-d36fff37-bbfd-4535-82b0-dec0f2d74cde tempest-VolumeDependencyTests-194956577 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:37:25 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d36fff37-bbfd-4535-82b0-dec0f2d74cde tempest-VolumeDependencyTests-194956577 None] Deleted volume successfully. Apr 29 17:37:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d36fff37-bbfd-4535-82b0-dec0f2d74cde tempest-VolumeDependencyTests-194956577 None] Lock "cinder-c0b2f2f6-9b45-4d2e-b438-4a24d43c3953-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Flow 'volume_create_manager' (72d1e5a2-244b-4b8f-a901-23d0025def2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2206de4e-b21c-4efb-ba1a-7cf84d298922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2206de4e-b21c-4efb-ba1a-7cf84d298922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-741885733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf40f31-7ec0-48dc-b177-c712fb871276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d099241fba48939cfd2059fd17247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:37:26Z,use_quota=True,user_id='49e2ec475c27427c860a96a339b0e8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4793dfc4-2ea9-40aa-b324-4d93fe2c0290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4793dfc4-2ea9-40aa-b324-4d93fe2c0290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324d5f1d-4d0c-4eff-818c-ff78fea0d6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324d5f1d-4d0c-4eff-818c-ff78fea0d6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddf40f31-7ec0-48dc-b177-c712fb871276', 'volume_name': 'volume-ddf40f31-7ec0-48dc-b177-c712fb871276', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0aac4a-4b1d-48f4-8475-ad9b51377156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c0aac4a-4b1d-48f4-8475-ad9b51377156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6346e34-b0a0-4398-a7a4-7d4821570d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:26 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Volume ddf40f31-7ec0-48dc-b177-c712fb871276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddf40f31-7ec0-48dc-b177-c712fb871276', 'volume_size': 1} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-741885733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddf40f31-7ec0-48dc-b177-c712fb871276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d099241fba48939cfd2059fd17247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:37:26Z,use_quota=True,user_id='49e2ec475c27427c860a96a339b0e8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Creating volume ddf40f31-7ec0-48dc-b177-c712fb871276 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:37:26 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:37:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:26 devstack sudo[111877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 1073741824 Apr 29 17:37:26 devstack sudo[111877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:27 devstack sudo[111877]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 1073741824" returned: 0 in 0.732s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:27 devstack sudo[111883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 Apr 29 17:37:27 devstack sudo[111883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:27 devstack sudo[111883]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276" returned: 0 in 0.585s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:27 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:37:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6346e34-b0a0-4398-a7a4-7d4821570d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddf40f31-7ec0-48dc-b177-c712fb871276', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d63e33-700c-4dd7-9da5-3111aa211ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:27 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Volume volume-ddf40f31-7ec0-48dc-b177-c712fb871276 (ddf40f31-7ec0-48dc-b177-c712fb871276): created successfully Apr 29 17:37:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3d63e33-700c-4dd7-9da5-3111aa211ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Flow 'volume_create_manager' (72d1e5a2-244b-4b8f-a901-23d0025def2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:37:27 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-0137e381-dfcd-46a4-94c6-96a88715a679 tempest-VolumeDependencyTests-194956577 None] Created volume successfully. Apr 29 17:37:28 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:37:28 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Flow 'volume_create_manager' (06d6da77-c0ff-4ef1-b5d0-c74809cbe825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:37:28 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6f865f-af72-4239-b0f0-ae5c048af555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6f865f-af72-4239-b0f0-ae5c048af555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-53403841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77a22daa-42aa-4e58-aa2d-a3023b19ce98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38d099241fba48939cfd2059fd17247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ddf40f31-7ec0-48dc-b177-c712fb871276,status='creating',terminated_at=None,updated_at=2026-04-29T15:37:29Z,use_quota=True,user_id='49e2ec475c27427c860a96a339b0e8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d81d7c-cf96-4ee4-8d4c-85ba13b76ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d81d7c-cf96-4ee4-8d4c-85ba13b76ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862b62d7-c1c0-4134-88f3-0a2e5a586fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862b62d7-c1c0-4134-88f3-0a2e5a586fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '77a22daa-42aa-4e58-aa2d-a3023b19ce98', 'volume_name': 'volume-77a22daa-42aa-4e58-aa2d-a3023b19ce98', 'volume_size': 1, 'source_volid': 'ddf40f31-7ec0-48dc-b177-c712fb871276', 'source_volstatus': 'available'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42efae63-0abd-4ea4-819a-455a05c84a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42efae63-0abd-4ea4-819a-455a05c84a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:29 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51eb9ebe-8cf3-4330-85b7-9a8ad8c960cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:29 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Volume 77a22daa-42aa-4e58-aa2d-a3023b19ce98: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-77a22daa-42aa-4e58-aa2d-a3023b19ce98', 'volume_size': 1, 'source_volid': 'ddf40f31-7ec0-48dc-b177-c712fb871276', 'source_volstatus': 'available'} Apr 29 17:37:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:29 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Cloning volume ddf40f31-7ec0-48dc-b177-c712fb871276 to volume 77a22daa-42aa-4e58-aa2d-a3023b19ce98 Apr 29 17:37:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Creating offline snapshot 924c42b9-c383-4fa8-82b6-81742c72e787 of volume ddf40f31-7ec0-48dc-b177-c712fb871276 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:37:29 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[86921aff-ec72-498e-af40-427eb7d425a8]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:37:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:29 devstack sudo[111886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 Apr 29 17:37:29 devstack sudo[111886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:29 devstack sudo[111886]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276" returned: 0 in 0.681s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:29 devstack sudo[111891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787 1G Apr 29 17:37:29 devstack sudo[111891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:30 devstack sudo[111891]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787 1G" returned: 0 in 0.710s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddf40f31-7ec0-48dc-b177-c712fb871276 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:30 devstack sudo[111896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddf40f31-7ec0-48dc-b177-c712fb871276 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787 Apr 29 17:37:30 devstack sudo[111896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:31 devstack sudo[111896]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddf40f31-7ec0-48dc-b177-c712fb871276 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787" returned: 0 in 0.621s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:31 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787 is being set with open permissions: ugo+rw Apr 29 17:37:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:31 devstack sudo[111901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787 Apr 29 17:37:31 devstack sudo[111901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:31 devstack sudo[111901]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787" returned: 0 in 0.571s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:31 devstack sudo[111904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.info Apr 29 17:37:31 devstack sudo[111904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:32 devstack sudo[111904]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.info" returned: 0 in 0.584s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:32 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.info is being set with open permissions: ugo+rw Apr 29 17:37:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:32 devstack sudo[111907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.info Apr 29 17:37:32 devstack sudo[111907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:32 devstack sudo[111907]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.info" returned: 0 in 0.579s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "cinder-quobyte-77a22daa-42aa-4e58-aa2d-a3023b19ce98" by "_copy_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:37:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-quobyte-77a22daa-42aa-4e58-aa2d-a3023b19ce98" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:37:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] snapshot: 924c42b9-c383-4fa8-82b6-81742c72e787, volume: 77a22daa-42aa-4e58-aa2d-a3023b19ce98, {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 17:37:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:37:32 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:37:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:32 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2df8ce-a4da-46db-9fc7-b778c84c26f9]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:37:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:33 devstack sudo[111910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787 Apr 29 17:37:33 devstack sudo[111910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:33 devstack sudo[111910]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787" returned: 0 in 0.682s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddf40f31-7ec0-48dc-b177-c712fb871276(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:37:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 17:37:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Creating direct copy from snapshot {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 17:37:33 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[8949266e-6ef1-4b88-b5d9-2d060911befb]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:37:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:33 devstack sudo[111915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 Apr 29 17:37:33 devstack sudo[111915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:34 devstack sudo[111915]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276" returned: 0 in 0.696s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:34 devstack cinder-volume[84547]: DEBUG cinder.utils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Path /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-77a22daa-42aa-4e58-aa2d-a3023b19ce98 not found in is_blk_device check {{(pid=84547) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 17:37:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-77a22daa-42aa-4e58-aa2d-a3023b19ce98 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:34 devstack sudo[111920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-77a22daa-42aa-4e58-aa2d-a3023b19ce98 Apr 29 17:37:34 devstack sudo[111920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:38 devstack sudo[111920]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-77a22daa-42aa-4e58-aa2d-a3023b19ce98" returned: 0 in 4.240s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:38 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7312c1-9105-44ab-ab2c-26d3cf3566ed]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:37:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:38 devstack sudo[111934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 Apr 29 17:37:38 devstack sudo[111934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:39 devstack sudo[111934]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276" returned: 0 in 0.874s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:39 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276, size 1024.00 MB, duration 4.24 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-77a22daa-42aa-4e58-aa2d-a3023b19ce98 {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:37:39 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Converted 1024.00 MB image at 241.46 MB/s Apr 29 17:37:39 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-77a22daa-42aa-4e58-aa2d-a3023b19ce98 is being set with open permissions: ugo+rw Apr 29 17:37:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-77a22daa-42aa-4e58-aa2d-a3023b19ce98 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:39 devstack sudo[111939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-77a22daa-42aa-4e58-aa2d-a3023b19ce98 Apr 29 17:37:39 devstack sudo[111939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:40 devstack sudo[111939]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-77a22daa-42aa-4e58-aa2d-a3023b19ce98" returned: 0 in 0.585s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:40 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-quobyte-77a22daa-42aa-4e58-aa2d-a3023b19ce98" released by "_copy_volume_from_snapshot" :: held 7.152s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:37:40 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=66,cinder:INSERT=23,cinder:UPDATE=86,cinder:DELETE=9 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:37:40 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "cinder-quobyte-924c42b9-c383-4fa8-82b6-81742c72e787" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:37:40 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-quobyte-924c42b9-c383-4fa8-82b6-81742c72e787" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:37:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Deleting offline snapshot 924c42b9-c383-4fa8-82b6-81742c72e787 of volume ddf40f31-7ec0-48dc-b177-c712fb871276 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:37:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] snapshot_file for this snap is: volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:37:40 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[8967dfe3-d496-4750-93df-db06c005e4fe]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:37:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:40 devstack sudo[111942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787 Apr 29 17:37:40 devstack sudo[111942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:40 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=95,cinder:DELETE=8,cinder:SELECT=68,cinder:INSERT=20 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:37:40 devstack sudo[111942]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787" returned: 0 in 0.678s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddf40f31-7ec0-48dc-b177-c712fb871276(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:37:40 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfddb09-302e-4491-9d11-7481cbc400f1]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:37:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:40 devstack sudo[111947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 Apr 29 17:37:40 devstack sudo[111947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:41 devstack sudo[111947]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276" returned: 0 in 0.666s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:41 devstack sudo[111952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787 Apr 29 17:37:41 devstack sudo[111952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:42 devstack sudo[111952]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787" returned: 0 in 0.656s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:42 devstack sudo[111957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787 Apr 29 17:37:42 devstack sudo[111957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:42 devstack sudo[111957]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276.924c42b9-c383-4fa8-82b6-81742c72e787" returned: 0 in 0.570s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-quobyte-924c42b9-c383-4fa8-82b6-81742c72e787" released by "_delete_snapshot" :: held 2.649s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:37:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.723s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51eb9ebe-8cf3-4330-85b7-9a8ad8c960cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77a22daa-42aa-4e58-aa2d-a3023b19ce98', 'volume_size': 1, 'source_volid': 'ddf40f31-7ec0-48dc-b177-c712fb871276', 'source_volstatus': 'available'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (502e5861-2b52-43f7-9ce7-af46a3dafa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:42 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Volume volume-77a22daa-42aa-4e58-aa2d-a3023b19ce98 (77a22daa-42aa-4e58-aa2d-a3023b19ce98): created successfully Apr 29 17:37:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (502e5861-2b52-43f7-9ce7-af46a3dafa43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Flow 'volume_create_manager' (06d6da77-c0ff-4ef1-b5d0-c74809cbe825) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:37:42 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4eca38d5-12b6-486f-88b7-661c332cf8f8 tempest-VolumeDependencyTests-194956577 None] Created volume successfully. Apr 29 17:37:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-fae73da4-65e4-427c-b9ee-8eb2ba7b9661 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "cinder-ddf40f31-7ec0-48dc-b177-c712fb871276-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:37:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-fae73da4-65e4-427c-b9ee-8eb2ba7b9661 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-ddf40f31-7ec0-48dc-b177-c712fb871276-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:37:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-fae73da4-65e4-427c-b9ee-8eb2ba7b9661 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "cinder-quobyte-ddf40f31-7ec0-48dc-b177-c712fb871276" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:37:43 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-fae73da4-65e4-427c-b9ee-8eb2ba7b9661 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-quobyte-ddf40f31-7ec0-48dc-b177-c712fb871276" acquired by "delete_volume" :: waited 0.015s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:37:43 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d91604-add7-439f-9854-5f767d6f425d]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:37:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fae73da4-65e4-427c-b9ee-8eb2ba7b9661 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:43 devstack sudo[111960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 Apr 29 17:37:43 devstack sudo[111960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:43 devstack sudo[111960]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fae73da4-65e4-427c-b9ee-8eb2ba7b9661 tempest-VolumeDependencyTests-194956577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276" returned: 0 in 0.676s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fae73da4-65e4-427c-b9ee-8eb2ba7b9661 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:43 devstack sudo[111965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276 Apr 29 17:37:43 devstack sudo[111965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:44 devstack sudo[111965]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fae73da4-65e4-427c-b9ee-8eb2ba7b9661 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ddf40f31-7ec0-48dc-b177-c712fb871276" returned: 0 in 0.579s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:44 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-fae73da4-65e4-427c-b9ee-8eb2ba7b9661 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-quobyte-ddf40f31-7ec0-48dc-b177-c712fb871276" released by "delete_volume" :: held 1.307s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:37:44 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-fae73da4-65e4-427c-b9ee-8eb2ba7b9661 tempest-VolumeDependencyTests-194956577 None] Created reservations ['13e06ed0-5817-48f9-b932-3d560a9a3a87', '2b30abef-386c-406d-9140-5f22a96d169f', '12396b8c-b879-4468-afb4-1a27015a05ba', '337e3820-3026-4d5f-bbad-ede0a5be62da'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:37:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fae73da4-65e4-427c-b9ee-8eb2ba7b9661 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fae73da4-65e4-427c-b9ee-8eb2ba7b9661 tempest-VolumeDependencyTests-194956577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fae73da4-65e4-427c-b9ee-8eb2ba7b9661 tempest-VolumeDependencyTests-194956577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:37:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-fae73da4-65e4-427c-b9ee-8eb2ba7b9661 tempest-VolumeDependencyTests-194956577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:37:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-fae73da4-65e4-427c-b9ee-8eb2ba7b9661 tempest-VolumeDependencyTests-194956577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fae73da4-65e4-427c-b9ee-8eb2ba7b9661 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:44 devstack sudo[111968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:37:44 devstack sudo[111968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:44 devstack sudo[111968]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-fae73da4-65e4-427c-b9ee-8eb2ba7b9661 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.569s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:44 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-fae73da4-65e4-427c-b9ee-8eb2ba7b9661 tempest-VolumeDependencyTests-194956577 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:37:45 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-fae73da4-65e4-427c-b9ee-8eb2ba7b9661 tempest-VolumeDependencyTests-194956577 None] Deleted volume successfully. Apr 29 17:37:45 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-fae73da4-65e4-427c-b9ee-8eb2ba7b9661 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-ddf40f31-7ec0-48dc-b177-c712fb871276-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:37:45 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-416cd1cb-25d8-4a54-ae47-032624bac834 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "cinder-77a22daa-42aa-4e58-aa2d-a3023b19ce98-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:37:45 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-416cd1cb-25d8-4a54-ae47-032624bac834 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-77a22daa-42aa-4e58-aa2d-a3023b19ce98-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:37:45 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-416cd1cb-25d8-4a54-ae47-032624bac834 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "cinder-quobyte-77a22daa-42aa-4e58-aa2d-a3023b19ce98" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:37:45 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-416cd1cb-25d8-4a54-ae47-032624bac834 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-quobyte-77a22daa-42aa-4e58-aa2d-a3023b19ce98" acquired by "delete_volume" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:37:45 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[20caf8ba-bf91-4b74-b371-1c2427746a5d]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:37:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-416cd1cb-25d8-4a54-ae47-032624bac834 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-77a22daa-42aa-4e58-aa2d-a3023b19ce98 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:45 devstack sudo[111971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-77a22daa-42aa-4e58-aa2d-a3023b19ce98 Apr 29 17:37:45 devstack sudo[111971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:45 devstack sudo[111971]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-416cd1cb-25d8-4a54-ae47-032624bac834 tempest-VolumeDependencyTests-194956577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-77a22daa-42aa-4e58-aa2d-a3023b19ce98" returned: 0 in 0.680s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-416cd1cb-25d8-4a54-ae47-032624bac834 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-77a22daa-42aa-4e58-aa2d-a3023b19ce98 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:45 devstack sudo[111976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-77a22daa-42aa-4e58-aa2d-a3023b19ce98 Apr 29 17:37:45 devstack sudo[111976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:46 devstack sudo[111976]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-416cd1cb-25d8-4a54-ae47-032624bac834 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-77a22daa-42aa-4e58-aa2d-a3023b19ce98" returned: 0 in 0.571s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-416cd1cb-25d8-4a54-ae47-032624bac834 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-quobyte-77a22daa-42aa-4e58-aa2d-a3023b19ce98" released by "delete_volume" :: held 1.289s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:37:46 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-416cd1cb-25d8-4a54-ae47-032624bac834 tempest-VolumeDependencyTests-194956577 None] Created reservations ['910f21d3-a675-42fe-b679-7812648a5f9e', '96ec8ef8-cfd4-4c78-af83-f4472b7fe5f1', 'd8802b05-581e-40bb-a1e4-8c5d41cd34e2', '9a426f56-ef2d-4137-b0cc-4bbbc1d757e4'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:37:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-416cd1cb-25d8-4a54-ae47-032624bac834 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-416cd1cb-25d8-4a54-ae47-032624bac834 tempest-VolumeDependencyTests-194956577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-416cd1cb-25d8-4a54-ae47-032624bac834 tempest-VolumeDependencyTests-194956577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:37:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-416cd1cb-25d8-4a54-ae47-032624bac834 tempest-VolumeDependencyTests-194956577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:37:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-416cd1cb-25d8-4a54-ae47-032624bac834 tempest-VolumeDependencyTests-194956577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-416cd1cb-25d8-4a54-ae47-032624bac834 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:46 devstack sudo[111979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:37:46 devstack sudo[111979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:47 devstack sudo[111979]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-416cd1cb-25d8-4a54-ae47-032624bac834 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.567s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:47 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-416cd1cb-25d8-4a54-ae47-032624bac834 tempest-VolumeDependencyTests-194956577 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:37:47 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-416cd1cb-25d8-4a54-ae47-032624bac834 tempest-VolumeDependencyTests-194956577 None] Deleted volume successfully. Apr 29 17:37:47 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-416cd1cb-25d8-4a54-ae47-032624bac834 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-77a22daa-42aa-4e58-aa2d-a3023b19ce98-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:37:47 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5cac57f3-a2e0-4331-840a-bfc0da68c8a5 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "cinder-34d59875-d680-4140-bb80-5d27c7f6eefc-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:37:47 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5cac57f3-a2e0-4331-840a-bfc0da68c8a5 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-34d59875-d680-4140-bb80-5d27c7f6eefc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:37:47 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5cac57f3-a2e0-4331-840a-bfc0da68c8a5 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "cinder-quobyte-34d59875-d680-4140-bb80-5d27c7f6eefc" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:37:47 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5cac57f3-a2e0-4331-840a-bfc0da68c8a5 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-quobyte-34d59875-d680-4140-bb80-5d27c7f6eefc" acquired by "delete_volume" :: waited 0.013s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:37:47 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b136f3ac-7e3f-49f2-81ec-b314c12e1999]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:37:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5cac57f3-a2e0-4331-840a-bfc0da68c8a5 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34d59875-d680-4140-bb80-5d27c7f6eefc {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:47 devstack sudo[111983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34d59875-d680-4140-bb80-5d27c7f6eefc Apr 29 17:37:47 devstack sudo[111983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:48 devstack sudo[111983]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5cac57f3-a2e0-4331-840a-bfc0da68c8a5 tempest-VolumeDependencyTests-194956577 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34d59875-d680-4140-bb80-5d27c7f6eefc" returned: 0 in 0.761s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5cac57f3-a2e0-4331-840a-bfc0da68c8a5 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34d59875-d680-4140-bb80-5d27c7f6eefc {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:48 devstack sudo[111988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34d59875-d680-4140-bb80-5d27c7f6eefc Apr 29 17:37:48 devstack sudo[111988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:48 devstack sudo[111988]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5cac57f3-a2e0-4331-840a-bfc0da68c8a5 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-34d59875-d680-4140-bb80-5d27c7f6eefc" returned: 0 in 0.606s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:48 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5cac57f3-a2e0-4331-840a-bfc0da68c8a5 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-quobyte-34d59875-d680-4140-bb80-5d27c7f6eefc" released by "delete_volume" :: held 1.407s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:37:48 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-5cac57f3-a2e0-4331-840a-bfc0da68c8a5 tempest-VolumeDependencyTests-194956577 None] Created reservations ['aa197c85-5067-4659-bba7-e8cb6087286d', '12c0734d-2278-4cae-b658-990384834eab', '144f8969-9c73-4530-8106-d00fac78e41d', 'd62dda3d-8359-43c9-9727-9a3acb58c109'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:37:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5cac57f3-a2e0-4331-840a-bfc0da68c8a5 tempest-VolumeDependencyTests-194956577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5cac57f3-a2e0-4331-840a-bfc0da68c8a5 tempest-VolumeDependencyTests-194956577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-5cac57f3-a2e0-4331-840a-bfc0da68c8a5 tempest-VolumeDependencyTests-194956577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:37:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-5cac57f3-a2e0-4331-840a-bfc0da68c8a5 tempest-VolumeDependencyTests-194956577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:37:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-5cac57f3-a2e0-4331-840a-bfc0da68c8a5 tempest-VolumeDependencyTests-194956577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5cac57f3-a2e0-4331-840a-bfc0da68c8a5 tempest-VolumeDependencyTests-194956577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:49 devstack sudo[111991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:37:49 devstack sudo[111991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:49 devstack sudo[111991]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-5cac57f3-a2e0-4331-840a-bfc0da68c8a5 tempest-VolumeDependencyTests-194956577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.590s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:49 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-5cac57f3-a2e0-4331-840a-bfc0da68c8a5 tempest-VolumeDependencyTests-194956577 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:37:49 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-5cac57f3-a2e0-4331-840a-bfc0da68c8a5 tempest-VolumeDependencyTests-194956577 None] Deleted volume successfully. Apr 29 17:37:49 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-5cac57f3-a2e0-4331-840a-bfc0da68c8a5 tempest-VolumeDependencyTests-194956577 None] Lock "cinder-34d59875-d680-4140-bb80-5d27c7f6eefc-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Flow 'volume_create_manager' (f012a393-4f57-45ee-8afc-911f57d8dc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1129a282-d75b-4fed-925e-549fa000d721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1129a282-d75b-4fed-925e-549fa000d721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd796454-510d-4ba0-84f7-71a829c35872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bf980cdecd5447ea25ffa9763b3b9d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:37:52Z,use_quota=True,user_id='682ce202ccdd48c386068c5031e204be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0daf0d-b170-4bcd-8845-338fdf68a956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0daf0d-b170-4bcd-8845-338fdf68a956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c581554-e284-4c83-b7ae-9fd90fbdaee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c581554-e284-4c83-b7ae-9fd90fbdaee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd796454-510d-4ba0-84f7-71a829c35872', 'volume_name': 'volume-bd796454-510d-4ba0-84f7-71a829c35872', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047aef67-4c3b-4c26-9961-88da095646b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (047aef67-4c3b-4c26-9961-88da095646b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9508709-e945-415c-b1bb-4f6c697342ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:52 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Volume bd796454-510d-4ba0-84f7-71a829c35872: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd796454-510d-4ba0-84f7-71a829c35872', 'volume_size': 1} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd796454-510d-4ba0-84f7-71a829c35872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bf980cdecd5447ea25ffa9763b3b9d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:37:52Z,use_quota=True,user_id='682ce202ccdd48c386068c5031e204be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Creating volume bd796454-510d-4ba0-84f7-71a829c35872 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:37:52 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:37:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bd796454-510d-4ba0-84f7-71a829c35872 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:52 devstack sudo[111994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bd796454-510d-4ba0-84f7-71a829c35872 1073741824 Apr 29 17:37:52 devstack sudo[111994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:53 devstack sudo[111994]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bd796454-510d-4ba0-84f7-71a829c35872 1073741824" returned: 0 in 0.771s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bd796454-510d-4ba0-84f7-71a829c35872 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:53 devstack sudo[112000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bd796454-510d-4ba0-84f7-71a829c35872 Apr 29 17:37:53 devstack sudo[112000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:53 devstack sudo[112000]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bd796454-510d-4ba0-84f7-71a829c35872" returned: 0 in 0.582s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:37:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9508709-e945-415c-b1bb-4f6c697342ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd796454-510d-4ba0-84f7-71a829c35872', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a174f480-a7d5-49db-a785-ce32dec75ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:53 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Volume volume-bd796454-510d-4ba0-84f7-71a829c35872 (bd796454-510d-4ba0-84f7-71a829c35872): created successfully Apr 29 17:37:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a174f480-a7d5-49db-a785-ce32dec75ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Flow 'volume_create_manager' (f012a393-4f57-45ee-8afc-911f57d8dc3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:37:53 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e0ef0c0b-f94f-4bb0-90a3-a7d61cca7c91 tempest-CinderUnicodeTest-1638703790 None] Created volume successfully. Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Flow 'volume_create_manager' (7eddef37-edeb-4ea2-8488-6d6da4e69fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bc0cda-c2bc-465c-bf2b-1e1af75deee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9bc0cda-c2bc-465c-bf2b-1e1af75deee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:37:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2011551679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb52c14e-02f0-4e35-b717-f902b7ea09b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bf980cdecd5447ea25ffa9763b3b9d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:37:55Z,use_quota=True,user_id='682ce202ccdd48c386068c5031e204be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4223dca6-d00d-44c7-a4d4-7d262f93c679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4223dca6-d00d-44c7-a4d4-7d262f93c679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d77d8f2b-b68e-4f64-b518-9fb2f3383920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d77d8f2b-b68e-4f64-b518-9fb2f3383920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb52c14e-02f0-4e35-b717-f902b7ea09b4', 'volume_name': 'volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb15a9e-67f0-48dd-b3a9-d3d986379dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb15a9e-67f0-48dd-b3a9-d3d986379dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed546502-049b-4171-b8df-20b89ccf5b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:54 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Volume bb52c14e-02f0-4e35-b717-f902b7ea09b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4', 'volume_size': 1} Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:37:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2011551679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb52c14e-02f0-4e35-b717-f902b7ea09b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bf980cdecd5447ea25ffa9763b3b9d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:37:55Z,use_quota=True,user_id='682ce202ccdd48c386068c5031e204be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Creating volume bb52c14e-02f0-4e35-b717-f902b7ea09b4 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:37:54 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:37:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:54 devstack sudo[112003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4 1073741824 Apr 29 17:37:54 devstack sudo[112003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:55 devstack sudo[112003]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4 1073741824" returned: 0 in 0.767s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:55 devstack sudo[112008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4 Apr 29 17:37:55 devstack sudo[112008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:56 devstack sudo[112008]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4" returned: 0 in 0.597s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:37:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.406s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:37:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed546502-049b-4171-b8df-20b89ccf5b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc346791-bb5f-4e2a-a81a-d0e67661475d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:37:56 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Volume volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4 (bb52c14e-02f0-4e35-b717-f902b7ea09b4): created successfully Apr 29 17:37:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc346791-bb5f-4e2a-a81a-d0e67661475d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:37:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Flow 'volume_create_manager' (7eddef37-edeb-4ea2-8488-6d6da4e69fc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:37:56 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f4cfb51e-0f16-4444-8b07-8b6f6c07f7b4 tempest-CinderUnicodeTest-1638703790 None] Created volume successfully. Apr 29 17:37:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6a8ff616-faad-43de-918c-3da0b876216d tempest-CinderUnicodeTest-1638703790 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:37:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6a8ff616-faad-43de-918c-3da0b876216d tempest-CinderUnicodeTest-1638703790 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:37:57 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-6a8ff616-faad-43de-918c-3da0b876216d tempest-CinderUnicodeTest-1638703790 None] Creating offline snapshot 098fca01-0969-43cf-b4a3-1d5010ac6336 of volume bb52c14e-02f0-4e35-b717-f902b7ea09b4 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:37:57 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[7983f96b-f082-44e4-b43b-065301318c49]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:37:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6a8ff616-faad-43de-918c-3da0b876216d tempest-CinderUnicodeTest-1638703790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:57 devstack sudo[112013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4 Apr 29 17:37:57 devstack sudo[112013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:58 devstack sudo[112013]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6a8ff616-faad-43de-918c-3da0b876216d tempest-CinderUnicodeTest-1638703790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4" returned: 0 in 0.702s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6a8ff616-faad-43de-918c-3da0b876216d tempest-CinderUnicodeTest-1638703790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.098fca01-0969-43cf-b4a3-1d5010ac6336 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:58 devstack sudo[112018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.098fca01-0969-43cf-b4a3-1d5010ac6336 1G Apr 29 17:37:58 devstack sudo[112018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:59 devstack sudo[112018]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6a8ff616-faad-43de-918c-3da0b876216d tempest-CinderUnicodeTest-1638703790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.098fca01-0969-43cf-b4a3-1d5010ac6336 1G" returned: 0 in 0.755s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6a8ff616-faad-43de-918c-3da0b876216d tempest-CinderUnicodeTest-1638703790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.098fca01-0969-43cf-b4a3-1d5010ac6336 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:59 devstack sudo[112024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.098fca01-0969-43cf-b4a3-1d5010ac6336 Apr 29 17:37:59 devstack sudo[112024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:37:59 devstack sudo[112024]: pam_unix(sudo:session): session closed for user root Apr 29 17:37:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6a8ff616-faad-43de-918c-3da0b876216d tempest-CinderUnicodeTest-1638703790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.098fca01-0969-43cf-b4a3-1d5010ac6336" returned: 0 in 0.622s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:37:59 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-6a8ff616-faad-43de-918c-3da0b876216d tempest-CinderUnicodeTest-1638703790 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.098fca01-0969-43cf-b4a3-1d5010ac6336 is being set with open permissions: ugo+rw Apr 29 17:37:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6a8ff616-faad-43de-918c-3da0b876216d tempest-CinderUnicodeTest-1638703790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.098fca01-0969-43cf-b4a3-1d5010ac6336 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:37:59 devstack sudo[112031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.098fca01-0969-43cf-b4a3-1d5010ac6336 Apr 29 17:37:59 devstack sudo[112031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:00 devstack sudo[112031]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6a8ff616-faad-43de-918c-3da0b876216d tempest-CinderUnicodeTest-1638703790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.098fca01-0969-43cf-b4a3-1d5010ac6336" returned: 0 in 0.588s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6a8ff616-faad-43de-918c-3da0b876216d tempest-CinderUnicodeTest-1638703790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:00 devstack sudo[112034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.info Apr 29 17:38:00 devstack sudo[112034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:00 devstack sudo[112034]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6a8ff616-faad-43de-918c-3da0b876216d tempest-CinderUnicodeTest-1638703790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.info" returned: 0 in 0.579s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:00 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-6a8ff616-faad-43de-918c-3da0b876216d tempest-CinderUnicodeTest-1638703790 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.info is being set with open permissions: ugo+rw Apr 29 17:38:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6a8ff616-faad-43de-918c-3da0b876216d tempest-CinderUnicodeTest-1638703790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:00 devstack sudo[112037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.info Apr 29 17:38:00 devstack sudo[112037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:01 devstack sudo[112037]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6a8ff616-faad-43de-918c-3da0b876216d tempest-CinderUnicodeTest-1638703790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.info" returned: 0 in 0.586s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6a8ff616-faad-43de-918c-3da0b876216d tempest-CinderUnicodeTest-1638703790 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.976s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:01 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-6a8ff616-faad-43de-918c-3da0b876216d tempest-CinderUnicodeTest-1638703790 None] Create snapshot completed successfully Apr 29 17:38:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] Acquiring lock "cinder-098fca01-0969-43cf-b4a3-1d5010ac6336-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] Lock "cinder-098fca01-0969-43cf-b4a3-1d5010ac6336-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] Acquiring lock "cinder-quobyte-bb52c14e-02f0-4e35-b717-f902b7ea09b4" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] Lock "cinder-quobyte-bb52c14e-02f0-4e35-b717-f902b7ea09b4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] Acquiring lock "cinder-quobyte-098fca01-0969-43cf-b4a3-1d5010ac6336" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] Lock "cinder-quobyte-098fca01-0969-43cf-b4a3-1d5010ac6336" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] Deleting offline snapshot 098fca01-0969-43cf-b4a3-1d5010ac6336 of volume bb52c14e-02f0-4e35-b717-f902b7ea09b4 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:38:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] snapshot_file for this snap is: volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.098fca01-0969-43cf-b4a3-1d5010ac6336 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:38:02 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[472dce9c-fac2-401e-867f-165506fce75f]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.098fca01-0969-43cf-b4a3-1d5010ac6336 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:02 devstack sudo[112040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.098fca01-0969-43cf-b4a3-1d5010ac6336 Apr 29 17:38:02 devstack sudo[112040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:03 devstack sudo[112040]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.098fca01-0969-43cf-b4a3-1d5010ac6336" returned: 0 in 0.707s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:38:03 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[20747b76-fb02-411d-a86f-8acd705352a3]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:03 devstack sudo[112045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4 Apr 29 17:38:03 devstack sudo[112045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:04 devstack sudo[112045]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4" returned: 0 in 0.701s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.098fca01-0969-43cf-b4a3-1d5010ac6336 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:04 devstack sudo[112050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.098fca01-0969-43cf-b4a3-1d5010ac6336 Apr 29 17:38:04 devstack sudo[112050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:04 devstack sudo[112050]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.098fca01-0969-43cf-b4a3-1d5010ac6336" returned: 0 in 0.693s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.098fca01-0969-43cf-b4a3-1d5010ac6336 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:04 devstack sudo[112055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.098fca01-0969-43cf-b4a3-1d5010ac6336 Apr 29 17:38:04 devstack sudo[112055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:05 devstack sudo[112055]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4.098fca01-0969-43cf-b4a3-1d5010ac6336" returned: 0 in 0.602s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] Lock "cinder-quobyte-098fca01-0969-43cf-b4a3-1d5010ac6336" released by "_delete_snapshot" :: held 2.805s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] Lock "cinder-quobyte-bb52c14e-02f0-4e35-b717-f902b7ea09b4" released by "delete_snapshot" :: held 2.830s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:05 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] Created reservations ['0d972d12-d751-46d8-a4e4-0462c60b943b', 'a64719d8-c747-4b7d-944f-19071cd10761', 'eb058d00-0774-424b-b1b4-5ccd4cb0bf2f', '56964403-c611-42c4-b3ab-957c277b251c'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:38:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:38:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:05 devstack sudo[112058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:38:05 devstack sudo[112058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:05 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] Delete snapshot completed successfully. Apr 29 17:38:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-0317d4cd-b830-4209-9f8b-ebdc885d3d54 tempest-CinderUnicodeTest-1638703790 None] Lock "cinder-098fca01-0969-43cf-b4a3-1d5010ac6336-delete_snapshot" released by "delete_snapshot" :: held 3.008s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dff98094-9b2c-4195-bbb6-17c78c108e1f tempest-CinderUnicodeTest-1638703790 None] Acquiring lock "cinder-bb52c14e-02f0-4e35-b717-f902b7ea09b4-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dff98094-9b2c-4195-bbb6-17c78c108e1f tempest-CinderUnicodeTest-1638703790 None] Lock "cinder-bb52c14e-02f0-4e35-b717-f902b7ea09b4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dff98094-9b2c-4195-bbb6-17c78c108e1f tempest-CinderUnicodeTest-1638703790 None] Acquiring lock "cinder-quobyte-bb52c14e-02f0-4e35-b717-f902b7ea09b4" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:05 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dff98094-9b2c-4195-bbb6-17c78c108e1f tempest-CinderUnicodeTest-1638703790 None] Lock "cinder-quobyte-bb52c14e-02f0-4e35-b717-f902b7ea09b4" acquired by "delete_volume" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:05 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7afc3e8-adbb-4c7d-be59-7d39baaf9508]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dff98094-9b2c-4195-bbb6-17c78c108e1f tempest-CinderUnicodeTest-1638703790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:06 devstack sudo[112060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4 Apr 29 17:38:06 devstack sudo[112060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:06 devstack sudo[112058]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.603s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:38:06 devstack sudo[112060]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dff98094-9b2c-4195-bbb6-17c78c108e1f tempest-CinderUnicodeTest-1638703790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4" returned: 0 in 0.716s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dff98094-9b2c-4195-bbb6-17c78c108e1f tempest-CinderUnicodeTest-1638703790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:06 devstack sudo[112066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4 Apr 29 17:38:06 devstack sudo[112066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:07 devstack sudo[112066]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dff98094-9b2c-4195-bbb6-17c78c108e1f tempest-CinderUnicodeTest-1638703790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bb52c14e-02f0-4e35-b717-f902b7ea09b4" returned: 0 in 0.613s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:07 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dff98094-9b2c-4195-bbb6-17c78c108e1f tempest-CinderUnicodeTest-1638703790 None] Lock "cinder-quobyte-bb52c14e-02f0-4e35-b717-f902b7ea09b4" released by "delete_volume" :: held 1.387s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:07 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-dff98094-9b2c-4195-bbb6-17c78c108e1f tempest-CinderUnicodeTest-1638703790 None] Created reservations ['e0900fc0-af8d-432b-ab5d-2a194ba9b8ee', '2ef9a010-e020-4e19-97a5-70627913e2fa', '6b7c0998-2deb-43f6-9546-f92f9059165f', '98ab8f4b-444d-4897-89a2-cdd867034d5e'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:38:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-dff98094-9b2c-4195-bbb6-17c78c108e1f tempest-CinderUnicodeTest-1638703790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-dff98094-9b2c-4195-bbb6-17c78c108e1f tempest-CinderUnicodeTest-1638703790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-dff98094-9b2c-4195-bbb6-17c78c108e1f tempest-CinderUnicodeTest-1638703790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-dff98094-9b2c-4195-bbb6-17c78c108e1f tempest-CinderUnicodeTest-1638703790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-dff98094-9b2c-4195-bbb6-17c78c108e1f tempest-CinderUnicodeTest-1638703790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dff98094-9b2c-4195-bbb6-17c78c108e1f tempest-CinderUnicodeTest-1638703790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:07 devstack sudo[112106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:38:07 devstack sudo[112106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:08 devstack sudo[112106]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dff98094-9b2c-4195-bbb6-17c78c108e1f tempest-CinderUnicodeTest-1638703790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.610s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:08 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-dff98094-9b2c-4195-bbb6-17c78c108e1f tempest-CinderUnicodeTest-1638703790 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:38:08 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-dff98094-9b2c-4195-bbb6-17c78c108e1f tempest-CinderUnicodeTest-1638703790 None] Deleted volume successfully. Apr 29 17:38:08 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dff98094-9b2c-4195-bbb6-17c78c108e1f tempest-CinderUnicodeTest-1638703790 None] Lock "cinder-bb52c14e-02f0-4e35-b717-f902b7ea09b4-delete_volume" released by "delete_volume" :: held 2.202s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:08 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-86f310f5-ce73-4f4e-916e-feb43473b12e tempest-CinderUnicodeTest-1638703790 None] Acquiring lock "cinder-bd796454-510d-4ba0-84f7-71a829c35872-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:08 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-86f310f5-ce73-4f4e-916e-feb43473b12e tempest-CinderUnicodeTest-1638703790 None] Lock "cinder-bd796454-510d-4ba0-84f7-71a829c35872-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:08 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-86f310f5-ce73-4f4e-916e-feb43473b12e tempest-CinderUnicodeTest-1638703790 None] Acquiring lock "cinder-quobyte-bd796454-510d-4ba0-84f7-71a829c35872" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:08 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-86f310f5-ce73-4f4e-916e-feb43473b12e tempest-CinderUnicodeTest-1638703790 None] Lock "cinder-quobyte-bd796454-510d-4ba0-84f7-71a829c35872" acquired by "delete_volume" :: waited 0.018s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:08 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[319c94fa-62e4-4f56-96e0-062fb586f65e]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-86f310f5-ce73-4f4e-916e-feb43473b12e tempest-CinderUnicodeTest-1638703790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bd796454-510d-4ba0-84f7-71a829c35872 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:08 devstack sudo[112109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bd796454-510d-4ba0-84f7-71a829c35872 Apr 29 17:38:08 devstack sudo[112109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:08 devstack sudo[112109]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-86f310f5-ce73-4f4e-916e-feb43473b12e tempest-CinderUnicodeTest-1638703790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bd796454-510d-4ba0-84f7-71a829c35872" returned: 0 in 0.705s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-86f310f5-ce73-4f4e-916e-feb43473b12e tempest-CinderUnicodeTest-1638703790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bd796454-510d-4ba0-84f7-71a829c35872 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:08 devstack sudo[112120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bd796454-510d-4ba0-84f7-71a829c35872 Apr 29 17:38:08 devstack sudo[112120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:09 devstack sudo[112120]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-86f310f5-ce73-4f4e-916e-feb43473b12e tempest-CinderUnicodeTest-1638703790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-bd796454-510d-4ba0-84f7-71a829c35872" returned: 0 in 0.603s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:09 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-86f310f5-ce73-4f4e-916e-feb43473b12e tempest-CinderUnicodeTest-1638703790 None] Lock "cinder-quobyte-bd796454-510d-4ba0-84f7-71a829c35872" released by "delete_volume" :: held 1.350s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:09 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-86f310f5-ce73-4f4e-916e-feb43473b12e tempest-CinderUnicodeTest-1638703790 None] Created reservations ['dc34b5b0-32de-4130-ada7-bbf9607ae2f5', 'e2cda62f-0650-4d01-9d54-b747e972fd90', 'dfc30eb7-5e2e-46b1-8e20-a530b83e51e0', 'd4a4e3fb-461e-4f6b-9762-8336991f4fb7'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:38:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-86f310f5-ce73-4f4e-916e-feb43473b12e tempest-CinderUnicodeTest-1638703790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-86f310f5-ce73-4f4e-916e-feb43473b12e tempest-CinderUnicodeTest-1638703790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-86f310f5-ce73-4f4e-916e-feb43473b12e tempest-CinderUnicodeTest-1638703790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:09 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-86f310f5-ce73-4f4e-916e-feb43473b12e tempest-CinderUnicodeTest-1638703790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-86f310f5-ce73-4f4e-916e-feb43473b12e tempest-CinderUnicodeTest-1638703790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-86f310f5-ce73-4f4e-916e-feb43473b12e tempest-CinderUnicodeTest-1638703790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:09 devstack sudo[112123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:38:09 devstack sudo[112123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:10 devstack sudo[112123]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-86f310f5-ce73-4f4e-916e-feb43473b12e tempest-CinderUnicodeTest-1638703790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.629s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:10 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-86f310f5-ce73-4f4e-916e-feb43473b12e tempest-CinderUnicodeTest-1638703790 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:38:10 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-86f310f5-ce73-4f4e-916e-feb43473b12e tempest-CinderUnicodeTest-1638703790 None] Deleted volume successfully. Apr 29 17:38:10 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-86f310f5-ce73-4f4e-916e-feb43473b12e tempest-CinderUnicodeTest-1638703790 None] Lock "cinder-bd796454-510d-4ba0-84f7-71a829c35872-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:19 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=60,cinder:SELECT=42,cinder:INSERT=15,cinder:DELETE=4 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:38:20 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=53,cinder:SELECT=36,cinder:DELETE=5,cinder:INSERT=13 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Flow 'volume_create_manager' (a3efa09f-3245-4309-9b67-97bcf976132e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063014c2-683b-4dab-96af-47dfe3428a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063014c2-683b-4dab-96af-47dfe3428a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1411904831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=155f720f-fce8-4b2d-8dce-4b12eb07ca04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701cd8d4915b40d29fc150b58b053ccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:22Z,use_quota=True,user_id='8a6df3c2c6114994b897c9d1d7484f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1518a55-1adf-46a2-baab-9ed30f4ba167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1518a55-1adf-46a2-baab-9ed30f4ba167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b586bd68-e709-494d-9109-84d662fd572b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b586bd68-e709-494d-9109-84d662fd572b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '155f720f-fce8-4b2d-8dce-4b12eb07ca04', 'volume_name': 'volume-155f720f-fce8-4b2d-8dce-4b12eb07ca04', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14af3e2-4702-441e-9821-004a831ec75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14af3e2-4702-441e-9821-004a831ec75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d520446-5878-456e-bc56-0097dc36bbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:22 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Volume 155f720f-fce8-4b2d-8dce-4b12eb07ca04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-155f720f-fce8-4b2d-8dce-4b12eb07ca04', 'volume_size': 1} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1411904831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=155f720f-fce8-4b2d-8dce-4b12eb07ca04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701cd8d4915b40d29fc150b58b053ccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:22Z,use_quota=True,user_id='8a6df3c2c6114994b897c9d1d7484f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Creating volume 155f720f-fce8-4b2d-8dce-4b12eb07ca04 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:38:22 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-155f720f-fce8-4b2d-8dce-4b12eb07ca04 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:22 devstack sudo[112167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-155f720f-fce8-4b2d-8dce-4b12eb07ca04 1073741824 Apr 29 17:38:22 devstack sudo[112167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Flow 'volume_create_manager' (761fb81a-42fb-45ad-a5d8-cba7e6e32dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ec53704-cc39-44f8-a37f-945e472989d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ec53704-cc39-44f8-a37f-945e472989d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2048614588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61815d80-1383-4d92-8758-0722c75618f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70949296e4c240ee8cf4ae44dd8cb2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:22Z,use_quota=True,user_id='af865355ad63453da440aa8fe58f2de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577ebd1c-4a18-4ac8-a5c5-bb70f1004957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577ebd1c-4a18-4ac8-a5c5-bb70f1004957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77dba886-d39c-4e3e-b1a5-6050ca79305c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77dba886-d39c-4e3e-b1a5-6050ca79305c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61815d80-1383-4d92-8758-0722c75618f7', 'volume_name': 'volume-61815d80-1383-4d92-8758-0722c75618f7', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2056b13f-a626-4291-81b7-bd0447f79bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2056b13f-a626-4291-81b7-bd0447f79bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8362f88-35b7-4740-bc5b-a128588d21f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:22 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Volume 61815d80-1383-4d92-8758-0722c75618f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61815d80-1383-4d92-8758-0722c75618f7', 'volume_size': 1} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Flow 'volume_create_manager' (e2f33d0b-c657-41cf-b009-243c80dcd54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61423e26-8c0f-4286-8a60-2a2bc67a5d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61423e26-8c0f-4286-8a60-2a2bc67a5d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1068643962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14067360-6470-40ad-aefc-2e3e8894ece6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701cd8d4915b40d29fc150b58b053ccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:23Z,use_quota=True,user_id='8a6df3c2c6114994b897c9d1d7484f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3233b6ab-6844-42e8-8b34-aa1432dfc62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3233b6ab-6844-42e8-8b34-aa1432dfc62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c85e9c-c066-4047-af1b-c314c7f111a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c85e9c-c066-4047-af1b-c314c7f111a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14067360-6470-40ad-aefc-2e3e8894ece6', 'volume_name': 'volume-14067360-6470-40ad-aefc-2e3e8894ece6', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23534931-c9be-4e12-af65-53b7769384ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23534931-c9be-4e12-af65-53b7769384ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a325fb0-1d84-49ab-967c-5345119fa723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:22 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Volume 14067360-6470-40ad-aefc-2e3e8894ece6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14067360-6470-40ad-aefc-2e3e8894ece6', 'volume_size': 1} Apr 29 17:38:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:23 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:38:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Flow 'volume_create_manager' (bd65dff1-cdef-4d55-8bfc-950726355d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0726543d-f99f-4927-b5d7-c8c3027850af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0726543d-f99f-4927-b5d7-c8c3027850af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-995885101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10d9ae3-c112-47e3-bbea-1a364112d850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701cd8d4915b40d29fc150b58b053ccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:23Z,use_quota=True,user_id='8a6df3c2c6114994b897c9d1d7484f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a53e197-2d64-443d-abed-1d6202004af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a53e197-2d64-443d-abed-1d6202004af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dbf570f-e27b-4382-967f-2305d896dca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dbf570f-e27b-4382-967f-2305d896dca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f10d9ae3-c112-47e3-bbea-1a364112d850', 'volume_name': 'volume-f10d9ae3-c112-47e3-bbea-1a364112d850', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5befe98-d45e-4fac-a842-fb488067da55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5befe98-d45e-4fac-a842-fb488067da55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc62f20-0f3f-4583-8d7b-cf7bdab66832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:23 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Volume f10d9ae3-c112-47e3-bbea-1a364112d850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f10d9ae3-c112-47e3-bbea-1a364112d850', 'volume_size': 1} Apr 29 17:38:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:23 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:38:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Flow 'volume_create_manager' (7edbf9e3-2ef2-46f7-9930-4130ad06d2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c56f9128-0e92-4e6e-aeed-841e396bd92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c56f9128-0e92-4e6e-aeed-841e396bd92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1944068946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122908e7-5801-4892-b0e3-652e0f2c7719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701cd8d4915b40d29fc150b58b053ccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:24Z,use_quota=True,user_id='8a6df3c2c6114994b897c9d1d7484f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4810a77-36ea-44ac-a47d-0fe97f1bc1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4810a77-36ea-44ac-a47d-0fe97f1bc1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386df83d-a864-446d-af00-6c2e001d51fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:23 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386df83d-a864-446d-af00-6c2e001d51fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '122908e7-5801-4892-b0e3-652e0f2c7719', 'volume_name': 'volume-122908e7-5801-4892-b0e3-652e0f2c7719', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:24 devstack sudo[112167]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2cde4b-bb96-4d2d-8134-82db69e69eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2cde4b-bb96-4d2d-8134-82db69e69eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20da2001-b945-4f6a-a932-f3b45e638171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:24 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Volume 122908e7-5801-4892-b0e3-652e0f2c7719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-122908e7-5801-4892-b0e3-652e0f2c7719', 'volume_size': 1} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-155f720f-fce8-4b2d-8dce-4b12eb07ca04 1073741824" returned: 0 in 1.563s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-155f720f-fce8-4b2d-8dce-4b12eb07ca04 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:24 devstack sudo[112172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-155f720f-fce8-4b2d-8dce-4b12eb07ca04 Apr 29 17:38:24 devstack sudo[112172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Flow 'volume_create_manager' (2a03d488-5aa5-4e33-89fd-cc5f682298c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a762a6-24ab-4261-a33f-65026ea5633f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a762a6-24ab-4261-a33f-65026ea5633f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1694248626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f30da2-4ba6-4167-8c01-fbb7b1f315c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701cd8d4915b40d29fc150b58b053ccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:24Z,use_quota=True,user_id='8a6df3c2c6114994b897c9d1d7484f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4406bef2-c20a-47bb-8352-6d59e853dc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4406bef2-c20a-47bb-8352-6d59e853dc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7c5f18-4dfb-4002-87af-bc5a9114cbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7c5f18-4dfb-4002-87af-bc5a9114cbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37f30da2-4ba6-4167-8c01-fbb7b1f315c8', 'volume_name': 'volume-37f30da2-4ba6-4167-8c01-fbb7b1f315c8', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba78618-d62c-4b79-b710-c07bf885de99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ba78618-d62c-4b79-b710-c07bf885de99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (909e0aec-ef58-4dff-af38-c6fbbc722c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:24 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Volume 37f30da2-4ba6-4167-8c01-fbb7b1f315c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37f30da2-4ba6-4167-8c01-fbb7b1f315c8', 'volume_size': 1} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:24 devstack sudo[112172]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-155f720f-fce8-4b2d-8dce-4b12eb07ca04" returned: 0 in 0.684s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] <== create_volume: return (2295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.301s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.110s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2048614588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61815d80-1383-4d92-8758-0722c75618f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70949296e4c240ee8cf4ae44dd8cb2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:22Z,use_quota=True,user_id='af865355ad63453da440aa8fe58f2de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Creating volume 61815d80-1383-4d92-8758-0722c75618f7 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:38:24 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d520446-5878-456e-bc56-0097dc36bbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-155f720f-fce8-4b2d-8dce-4b12eb07ca04', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:24 devstack sudo[112175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 1073741824 Apr 29 17:38:24 devstack sudo[112175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22c1d9a-2b2b-42ef-951d-7d18f05e33eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:24 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Volume volume-155f720f-fce8-4b2d-8dce-4b12eb07ca04 (155f720f-fce8-4b2d-8dce-4b12eb07ca04): created successfully Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22c1d9a-2b2b-42ef-951d-7d18f05e33eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:24 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Flow 'volume_create_manager' (a3efa09f-3245-4309-9b67-97bcf976132e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:24 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d483c512-e89c-476f-b06b-380da3103b41 tempest-CreateVolumesFromImageTest-1274051230 None] Created volume successfully. Apr 29 17:38:25 devstack sudo[112175]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 1073741824" returned: 0 in 0.991s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:25 devstack sudo[112181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 Apr 29 17:38:25 devstack sudo[112181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:26 devstack sudo[112181]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7" returned: 0 in 0.680s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.598s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1068643962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14067360-6470-40ad-aefc-2e3e8894ece6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701cd8d4915b40d29fc150b58b053ccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:23Z,use_quota=True,user_id='8a6df3c2c6114994b897c9d1d7484f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Creating volume 14067360-6470-40ad-aefc-2e3e8894ece6 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:38:26 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14067360-6470-40ad-aefc-2e3e8894ece6 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8362f88-35b7-4740-bc5b-a128588d21f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61815d80-1383-4d92-8758-0722c75618f7', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5be79f-c2fb-48c7-9a3e-724deb177413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:26 devstack sudo[112184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14067360-6470-40ad-aefc-2e3e8894ece6 1073741824 Apr 29 17:38:26 devstack sudo[112184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:26 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Volume volume-61815d80-1383-4d92-8758-0722c75618f7 (61815d80-1383-4d92-8758-0722c75618f7): created successfully Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5be79f-c2fb-48c7-9a3e-724deb177413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Flow 'volume_create_manager' (761fb81a-42fb-45ad-a5d8-cba7e6e32dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:26 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-66d0b66b-1dfc-4ff7-9180-980354e0bb99 tempest-VolumeDependencyTests-1128192403 None] Created volume successfully. Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Flow 'volume_create_manager' (3226247d-60ef-43dd-9b75-ce6c5de3e1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928ae9c3-ed42-4981-baed-e701f8cfab0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928ae9c3-ed42-4981-baed-e701f8cfab0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2afba920-2b67-47f3-b1b7-169d10b66adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2110a984f7497eba5314bd89eb4594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:27Z,use_quota=True,user_id='2e24dde265854266a4dc5a3cf6ce3e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4aff6aec-92d5-4f40-a127-fec5e0463cc3),volume_type_id=4aff6aec-92d5-4f40-a127-fec5e0463cc3)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdecf598-14d6-45c2-a03b-845b0f4a60ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdecf598-14d6-45c2-a03b-845b0f4a60ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2fa803-28e4-4606-8f8a-4734b3d53504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:26 devstack cinder-volume[84547]: DEBUG cinder.image.glance [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Creating Keystone auth plugin from conf {{(pid=84547) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 17:38:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2fa803-28e4-4606-8f8a-4734b3d53504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2afba920-2b67-47f3-b1b7-169d10b66adb', 'volume_name': 'volume-2afba920-2b67-47f3-b1b7-169d10b66adb', 'volume_size': 1, 'image_id': '06eaa17c-152f-44a0-aade-7d2dda1abde4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/06eaa17c-152f-44a0-aade-7d2dda1abde4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c3ce9fb9008ef5b603b9280976f0ed6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef2110a984f7497eba5314bd89eb4594', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '58681a7f4c849f6073c47af2e266520697d913af0733840a536fd1d9eff2d9f868154391a1f2283d7e5f0dd58d6f962f3d7f355b8877fa047397fa0d7271e63e', 'id': '06eaa17c-152f-44a0-aade-7d2dda1abde4', 'created_at': datetime.datetime(2026, 4, 29, 15, 38, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 38, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/06eaa17c-152f-44a0-aade-7d2dda1abde4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47a29a8-a6eb-4b91-89f5-d444e0c21af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b47a29a8-a6eb-4b91-89f5-d444e0c21af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:27 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59b5265-f3bd-4906-9ea8-5d3eda968212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:27 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Volume 2afba920-2b67-47f3-b1b7-169d10b66adb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2afba920-2b67-47f3-b1b7-169d10b66adb', 'volume_size': 1, 'image_id': '06eaa17c-152f-44a0-aade-7d2dda1abde4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/06eaa17c-152f-44a0-aade-7d2dda1abde4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c3ce9fb9008ef5b603b9280976f0ed6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef2110a984f7497eba5314bd89eb4594', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '58681a7f4c849f6073c47af2e266520697d913af0733840a536fd1d9eff2d9f868154391a1f2283d7e5f0dd58d6f962f3d7f355b8877fa047397fa0d7271e63e', 'id': '06eaa17c-152f-44a0-aade-7d2dda1abde4', 'created_at': datetime.datetime(2026, 4, 29, 15, 38, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 38, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/06eaa17c-152f-44a0-aade-7d2dda1abde4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Apr 29 17:38:27 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Trying to clone 2afba920-2b67-47f3-b1b7-169d10b66adb from image 06eaa17c-152f-44a0-aade-7d2dda1abde4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/06eaa17c-152f-44a0-aade-7d2dda1abde4', 'metadata': {}}]). {{(pid=84547) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 17:38:27 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 17:38:27 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Image download 0.00 MB at 0.00 MB/s Apr 29 17:38:27 devstack sudo[112184]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14067360-6470-40ad-aefc-2e3e8894ece6 1073741824" returned: 0 in 0.869s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:27 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[9420c532-cf4c-49b7-b65f-0b4c21d9b9fc]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14067360-6470-40ad-aefc-2e3e8894ece6 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:27 devstack sudo[112192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14067360-6470-40ad-aefc-2e3e8894ece6 Apr 29 17:38:27 devstack sudo[112192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:27 devstack sudo[112191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD Apr 29 17:38:27 devstack sudo[112191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d05c2994-ed82-4602-a609-3d63e9aebffe tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:28 devstack sudo[112192]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14067360-6470-40ad-aefc-2e3e8894ece6" returned: 0 in 0.909s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:38:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.963s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-995885101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10d9ae3-c112-47e3-bbea-1a364112d850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701cd8d4915b40d29fc150b58b053ccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:23Z,use_quota=True,user_id='8a6df3c2c6114994b897c9d1d7484f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:38:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Creating volume f10d9ae3-c112-47e3-bbea-1a364112d850 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:38:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:28 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:38:28 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:38:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f10d9ae3-c112-47e3-bbea-1a364112d850 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:28 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a325fb0-1d84-49ab-967c-5345119fa723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14067360-6470-40ad-aefc-2e3e8894ece6', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:28 devstack sudo[112198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f10d9ae3-c112-47e3-bbea-1a364112d850 1073741824 Apr 29 17:38:28 devstack sudo[112198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:28 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bff7ca-3476-4516-a267-98187777a36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:28 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Volume volume-14067360-6470-40ad-aefc-2e3e8894ece6 (14067360-6470-40ad-aefc-2e3e8894ece6): created successfully Apr 29 17:38:28 devstack sudo[112191]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:28 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bff7ca-3476-4516-a267-98187777a36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:28 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Flow 'volume_create_manager' (e2f33d0b-c657-41cf-b009-243c80dcd54a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD" returned: 0 in 1.047s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:28 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-0fe226d5-ce62-4c8f-8f81-dd8a07b42354 tempest-CreateVolumesFromImageTest-1274051230 None] Created volume successfully. Apr 29 17:38:28 devstack sudo[112200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD Apr 29 17:38:28 devstack sudo[112200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:29 devstack sudo[112200]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD" returned: 1 in 0.775s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:38:29 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Temporary image 06eaa17c-152f-44a0-aade-7d2dda1abde4 is fetched for user 2e24dde265854266a4dc5a3cf6ce3e63. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 17:38:29 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b279b39-3512-4e6d-80fd-d4240637eb0c]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:29 devstack sudo[112198]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f10d9ae3-c112-47e3-bbea-1a364112d850 1073741824" returned: 0 in 0.957s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f10d9ae3-c112-47e3-bbea-1a364112d850 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:29 devstack sudo[112210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f10d9ae3-c112-47e3-bbea-1a364112d850 Apr 29 17:38:29 devstack sudo[112210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:29 devstack sudo[112209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD Apr 29 17:38:29 devstack sudo[112209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:29 devstack sudo[112210]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f10d9ae3-c112-47e3-bbea-1a364112d850" returned: 0 in 0.639s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:38:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.961s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1944068946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122908e7-5801-4892-b0e3-652e0f2c7719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701cd8d4915b40d29fc150b58b053ccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:24Z,use_quota=True,user_id='8a6df3c2c6114994b897c9d1d7484f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:38:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Creating volume 122908e7-5801-4892-b0e3-652e0f2c7719 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:38:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:29 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:38:29 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:38:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-122908e7-5801-4892-b0e3-652e0f2c7719 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:29 devstack sudo[112209]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD" returned: 0 in 0.735s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:30 devstack sudo[112216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-122908e7-5801-4892-b0e3-652e0f2c7719 1073741824 Apr 29 17:38:30 devstack sudo[112216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc62f20-0f3f-4583-8d7b-cf7bdab66832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f10d9ae3-c112-47e3-bbea-1a364112d850', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99918eb3-b570-4727-b752-6295625270f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:30 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Volume volume-f10d9ae3-c112-47e3-bbea-1a364112d850 (f10d9ae3-c112-47e3-bbea-1a364112d850): created successfully Apr 29 17:38:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99918eb3-b570-4727-b752-6295625270f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:30 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Flow 'volume_create_manager' (bd65dff1-cdef-4d55-8bfc-950726355d28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:30 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-6b046fec-5191-4fcc-a043-7e8ad6d5fb69 tempest-CreateVolumesFromImageTest-1274051230 None] Created volume successfully. Apr 29 17:38:30 devstack sudo[112218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD Apr 29 17:38:30 devstack sudo[112218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:30 devstack sudo[112218]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD" returned: 1 in 0.870s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:38:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:30 devstack sudo[112216]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-122908e7-5801-4892-b0e3-652e0f2c7719 1073741824" returned: 0 in 0.974s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-122908e7-5801-4892-b0e3-652e0f2c7719 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:31 devstack sudo[112228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-122908e7-5801-4892-b0e3-652e0f2c7719 Apr 29 17:38:31 devstack sudo[112228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:31 devstack sudo[112228]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-122908e7-5801-4892-b0e3-652e0f2c7719" returned: 0 in 0.625s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:38:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.333s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1694248626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f30da2-4ba6-4167-8c01-fbb7b1f315c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701cd8d4915b40d29fc150b58b053ccc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:24Z,use_quota=True,user_id='8a6df3c2c6114994b897c9d1d7484f14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:38:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Creating volume 37f30da2-4ba6-4167-8c01-fbb7b1f315c8 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:38:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:31 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:38:31 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:38:31 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-37f30da2-4ba6-4167-8c01-fbb7b1f315c8 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20da2001-b945-4f6a-a932-f3b45e638171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-122908e7-5801-4892-b0e3-652e0f2c7719', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:31 devstack sudo[112231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-37f30da2-4ba6-4167-8c01-fbb7b1f315c8 1073741824 Apr 29 17:38:31 devstack sudo[112231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46798a5-20cc-44cd-a693-77e7f3bbbbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:31 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Volume volume-122908e7-5801-4892-b0e3-652e0f2c7719 (122908e7-5801-4892-b0e3-652e0f2c7719): created successfully Apr 29 17:38:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46798a5-20cc-44cd-a693-77e7f3bbbbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:31 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Flow 'volume_create_manager' (7edbf9e3-2ef2-46f7-9930-4130ad06d2d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:31 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ec0552c3-a9a8-465d-ada9-a5938224add7 tempest-CreateVolumesFromImageTest-1274051230 None] Created volume successfully. Apr 29 17:38:32 devstack sudo[112231]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-37f30da2-4ba6-4167-8c01-fbb7b1f315c8 1073741824" returned: 0 in 0.849s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-37f30da2-4ba6-4167-8c01-fbb7b1f315c8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:32 devstack sudo[112237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-37f30da2-4ba6-4167-8c01-fbb7b1f315c8 Apr 29 17:38:32 devstack sudo[112237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:33 devstack sudo[112237]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-37f30da2-4ba6-4167-8c01-fbb7b1f315c8" returned: 0 in 0.697s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:38:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d05c2994-ed82-4602-a609-3d63e9aebffe tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.161s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (909e0aec-ef58-4dff-af38-c6fbbc722c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f30da2-4ba6-4167-8c01-fbb7b1f315c8', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04223e3-56d4-478a-802c-66dee038c7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-d05c2994-ed82-4602-a609-3d63e9aebffe tempest-VolumeDependencyTests-1128192403 None] Creating offline snapshot 26a7e2ac-a73d-4da8-b115-a5ad08c4a546 of volume 61815d80-1383-4d92-8758-0722c75618f7 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:38:33 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Volume volume-37f30da2-4ba6-4167-8c01-fbb7b1f315c8 (37f30da2-4ba6-4167-8c01-fbb7b1f315c8): created successfully Apr 29 17:38:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c04223e3-56d4-478a-802c-66dee038c7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Flow 'volume_create_manager' (2a03d488-5aa5-4e33-89fd-cc5f682298c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:33 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20b05f0-1f44-42f6-b0d4-51a769401418]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d05c2994-ed82-4602-a609-3d63e9aebffe tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:33 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-9d897dad-e375-45ec-81bc-f60d82115d5d tempest-CreateVolumesFromImageTest-1274051230 None] Created volume successfully. Apr 29 17:38:33 devstack sudo[112240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 Apr 29 17:38:33 devstack sudo[112240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:34 devstack sudo[112240]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d05c2994-ed82-4602-a609-3d63e9aebffe tempest-VolumeDependencyTests-1128192403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7" returned: 0 in 0.746s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d05c2994-ed82-4602-a609-3d63e9aebffe tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:34 devstack sudo[112245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546 1G Apr 29 17:38:34 devstack sudo[112245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f74946d6-1c5b-4b1c-bb84-bbf84398691d tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "cinder-37f30da2-4ba6-4167-8c01-fbb7b1f315c8-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f74946d6-1c5b-4b1c-bb84-bbf84398691d tempest-CreateVolumesFromImageTest-1274051230 None] Lock "cinder-37f30da2-4ba6-4167-8c01-fbb7b1f315c8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f74946d6-1c5b-4b1c-bb84-bbf84398691d tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "cinder-quobyte-37f30da2-4ba6-4167-8c01-fbb7b1f315c8" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:34 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f74946d6-1c5b-4b1c-bb84-bbf84398691d tempest-CreateVolumesFromImageTest-1274051230 None] Lock "cinder-quobyte-37f30da2-4ba6-4167-8c01-fbb7b1f315c8" acquired by "delete_volume" :: waited 0.023s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:34 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[0310ff55-92fe-4850-b9d8-a85f7774d5ee]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f74946d6-1c5b-4b1c-bb84-bbf84398691d tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-37f30da2-4ba6-4167-8c01-fbb7b1f315c8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:34 devstack sudo[112247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-37f30da2-4ba6-4167-8c01-fbb7b1f315c8 Apr 29 17:38:34 devstack sudo[112247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:34 devstack sudo[112245]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d05c2994-ed82-4602-a609-3d63e9aebffe tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546 1G" returned: 0 in 0.902s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d05c2994-ed82-4602-a609-3d63e9aebffe tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61815d80-1383-4d92-8758-0722c75618f7 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:34 devstack sudo[112252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61815d80-1383-4d92-8758-0722c75618f7 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546 Apr 29 17:38:34 devstack sudo[112252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:35 devstack sudo[112247]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f74946d6-1c5b-4b1c-bb84-bbf84398691d tempest-CreateVolumesFromImageTest-1274051230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-37f30da2-4ba6-4167-8c01-fbb7b1f315c8" returned: 0 in 0.817s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f74946d6-1c5b-4b1c-bb84-bbf84398691d tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-37f30da2-4ba6-4167-8c01-fbb7b1f315c8 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:35 devstack sudo[112257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-37f30da2-4ba6-4167-8c01-fbb7b1f315c8 Apr 29 17:38:35 devstack sudo[112257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:35 devstack sudo[112252]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d05c2994-ed82-4602-a609-3d63e9aebffe tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61815d80-1383-4d92-8758-0722c75618f7 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546" returned: 0 in 0.692s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:35 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-d05c2994-ed82-4602-a609-3d63e9aebffe tempest-VolumeDependencyTests-1128192403 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546 is being set with open permissions: ugo+rw Apr 29 17:38:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d05c2994-ed82-4602-a609-3d63e9aebffe tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:35 devstack sudo[112262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546 Apr 29 17:38:35 devstack sudo[112262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:35 devstack sudo[112257]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f74946d6-1c5b-4b1c-bb84-bbf84398691d tempest-CreateVolumesFromImageTest-1274051230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-37f30da2-4ba6-4167-8c01-fbb7b1f315c8" returned: 0 in 0.680s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:35 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f74946d6-1c5b-4b1c-bb84-bbf84398691d tempest-CreateVolumesFromImageTest-1274051230 None] Lock "cinder-quobyte-37f30da2-4ba6-4167-8c01-fbb7b1f315c8" released by "delete_volume" :: held 1.555s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:35 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-f74946d6-1c5b-4b1c-bb84-bbf84398691d tempest-CreateVolumesFromImageTest-1274051230 None] Created reservations ['cb2f88bd-b3de-4932-b4eb-263762770761', '97ebca58-ba6e-4637-a428-5e1ab420ad15', '43a30dd5-a768-4a5b-b9ee-11a0f206b3ef', '54d93766-c0af-4a07-aee6-3fba288e4c34'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:38:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f74946d6-1c5b-4b1c-bb84-bbf84398691d tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f74946d6-1c5b-4b1c-bb84-bbf84398691d tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:36 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f74946d6-1c5b-4b1c-bb84-bbf84398691d tempest-CreateVolumesFromImageTest-1274051230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:36 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f74946d6-1c5b-4b1c-bb84-bbf84398691d tempest-CreateVolumesFromImageTest-1274051230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f74946d6-1c5b-4b1c-bb84-bbf84398691d tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f74946d6-1c5b-4b1c-bb84-bbf84398691d tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:36 devstack sudo[112266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:38:36 devstack sudo[112266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:36 devstack sudo[112262]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d05c2994-ed82-4602-a609-3d63e9aebffe tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546" returned: 0 in 0.647s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d05c2994-ed82-4602-a609-3d63e9aebffe tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:36 devstack sudo[112269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.info Apr 29 17:38:36 devstack sudo[112269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:36 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-32710537-938a-4e5c-b250-f84639648c5b tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "cinder-122908e7-5801-4892-b0e3-652e0f2c7719-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:36 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-32710537-938a-4e5c-b250-f84639648c5b tempest-CreateVolumesFromImageTest-1274051230 None] Lock "cinder-122908e7-5801-4892-b0e3-652e0f2c7719-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:36 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-32710537-938a-4e5c-b250-f84639648c5b tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "cinder-quobyte-122908e7-5801-4892-b0e3-652e0f2c7719" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:36 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-32710537-938a-4e5c-b250-f84639648c5b tempest-CreateVolumesFromImageTest-1274051230 None] Lock "cinder-quobyte-122908e7-5801-4892-b0e3-652e0f2c7719" acquired by "delete_volume" :: waited 0.032s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:36 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b08ec76-7fa5-49d8-921e-fbf0e4b94eba]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-32710537-938a-4e5c-b250-f84639648c5b tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-122908e7-5801-4892-b0e3-652e0f2c7719 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:36 devstack sudo[112266]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f74946d6-1c5b-4b1c-bb84-bbf84398691d tempest-CreateVolumesFromImageTest-1274051230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.670s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:36 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-f74946d6-1c5b-4b1c-bb84-bbf84398691d tempest-CreateVolumesFromImageTest-1274051230 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:38:36 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f74946d6-1c5b-4b1c-bb84-bbf84398691d tempest-CreateVolumesFromImageTest-1274051230 None] Deleted volume successfully. Apr 29 17:38:36 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f74946d6-1c5b-4b1c-bb84-bbf84398691d tempest-CreateVolumesFromImageTest-1274051230 None] Lock "cinder-37f30da2-4ba6-4167-8c01-fbb7b1f315c8-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:36 devstack sudo[112272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-122908e7-5801-4892-b0e3-652e0f2c7719 Apr 29 17:38:36 devstack sudo[112272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:37 devstack sudo[112269]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d05c2994-ed82-4602-a609-3d63e9aebffe tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.info" returned: 0 in 0.800s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:37 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-d05c2994-ed82-4602-a609-3d63e9aebffe tempest-VolumeDependencyTests-1128192403 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.info is being set with open permissions: ugo+rw Apr 29 17:38:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d05c2994-ed82-4602-a609-3d63e9aebffe tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:37 devstack sudo[112276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.info Apr 29 17:38:37 devstack sudo[112276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:37 devstack sudo[112272]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-32710537-938a-4e5c-b250-f84639648c5b tempest-CreateVolumesFromImageTest-1274051230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-122908e7-5801-4892-b0e3-652e0f2c7719" returned: 0 in 0.841s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-32710537-938a-4e5c-b250-f84639648c5b tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-122908e7-5801-4892-b0e3-652e0f2c7719 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:37 devstack sudo[112281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-122908e7-5801-4892-b0e3-652e0f2c7719 Apr 29 17:38:37 devstack sudo[112281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:37 devstack sudo[112276]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d05c2994-ed82-4602-a609-3d63e9aebffe tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.info" returned: 0 in 0.734s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d05c2994-ed82-4602-a609-3d63e9aebffe tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.649s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.994s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2afba920-2b67-47f3-b1b7-169d10b66adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2110a984f7497eba5314bd89eb4594',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:27Z,use_quota=True,user_id='2e24dde265854266a4dc5a3cf6ce3e63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4aff6aec-92d5-4f40-a127-fec5e0463cc3),volume_type_id=4aff6aec-92d5-4f40-a127-fec5e0463cc3)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:38:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Creating volume 2afba920-2b67-47f3-b1b7-169d10b66adb {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:38:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:38:37 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:38:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:37 devstack sudo[112284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb 1073741824 Apr 29 17:38:37 devstack sudo[112284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:37 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d05c2994-ed82-4602-a609-3d63e9aebffe tempest-VolumeDependencyTests-1128192403 None] Create snapshot completed successfully Apr 29 17:38:38 devstack sudo[112281]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-32710537-938a-4e5c-b250-f84639648c5b tempest-CreateVolumesFromImageTest-1274051230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-122908e7-5801-4892-b0e3-652e0f2c7719" returned: 0 in 0.683s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:38 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-32710537-938a-4e5c-b250-f84639648c5b tempest-CreateVolumesFromImageTest-1274051230 None] Lock "cinder-quobyte-122908e7-5801-4892-b0e3-652e0f2c7719" released by "delete_volume" :: held 1.585s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:38 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-32710537-938a-4e5c-b250-f84639648c5b tempest-CreateVolumesFromImageTest-1274051230 None] Created reservations ['108bb539-6ed0-41a4-bc38-318271ac62d7', 'a0f14072-b3ff-4708-a5bc-a1c54dd0d2ed', 'cd1a3109-3b66-43c7-8aed-0e7639d3b20d', '0676a51b-5ad5-4e9f-84f5-924392a0e7fc'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:38:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-32710537-938a-4e5c-b250-f84639648c5b tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-32710537-938a-4e5c-b250-f84639648c5b tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:38 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-32710537-938a-4e5c-b250-f84639648c5b tempest-CreateVolumesFromImageTest-1274051230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:38 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-32710537-938a-4e5c-b250-f84639648c5b tempest-CreateVolumesFromImageTest-1274051230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-32710537-938a-4e5c-b250-f84639648c5b tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-32710537-938a-4e5c-b250-f84639648c5b tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:38 devstack sudo[112287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:38:38 devstack sudo[112287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4c7dc9ad-e99c-4bd0-8772-d4d6d76dd35a tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "cinder-f10d9ae3-c112-47e3-bbea-1a364112d850-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:39 devstack sudo[112284]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb 1073741824" returned: 0 in 1.196s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4c7dc9ad-e99c-4bd0-8772-d4d6d76dd35a tempest-CreateVolumesFromImageTest-1274051230 None] Lock "cinder-f10d9ae3-c112-47e3-bbea-1a364112d850-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4c7dc9ad-e99c-4bd0-8772-d4d6d76dd35a tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "cinder-quobyte-f10d9ae3-c112-47e3-bbea-1a364112d850" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:39 devstack sudo[112294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb Apr 29 17:38:39 devstack sudo[112294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4c7dc9ad-e99c-4bd0-8772-d4d6d76dd35a tempest-CreateVolumesFromImageTest-1274051230 None] Lock "cinder-quobyte-f10d9ae3-c112-47e3-bbea-1a364112d850" acquired by "delete_volume" :: waited 0.036s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5771742-b408-4ede-97b2-a67a5a18847d]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4c7dc9ad-e99c-4bd0-8772-d4d6d76dd35a tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f10d9ae3-c112-47e3-bbea-1a364112d850 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:39 devstack sudo[112287]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-32710537-938a-4e5c-b250-f84639648c5b tempest-CreateVolumesFromImageTest-1274051230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.021s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-32710537-938a-4e5c-b250-f84639648c5b tempest-CreateVolumesFromImageTest-1274051230 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:38:39 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-32710537-938a-4e5c-b250-f84639648c5b tempest-CreateVolumesFromImageTest-1274051230 None] Deleted volume successfully. Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-32710537-938a-4e5c-b250-f84639648c5b tempest-CreateVolumesFromImageTest-1274051230 None] Lock "cinder-122908e7-5801-4892-b0e3-652e0f2c7719-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Flow 'volume_create_manager' (37225982-abcb-4809-b04e-a193b1d81bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:39 devstack sudo[112296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f10d9ae3-c112-47e3-bbea-1a364112d850 Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a280c466-6408-459a-9e48-90be2edd2ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:39 devstack sudo[112296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a280c466-6408-459a-9e48-90be2edd2ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-125951219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234eef1f-eb66-4ed1-ad77-0e884721f0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70949296e4c240ee8cf4ae44dd8cb2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=26a7e2ac-a73d-4da8-b115-a5ad08c4a546,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:39Z,use_quota=True,user_id='af865355ad63453da440aa8fe58f2de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb67d8a4-c51a-4513-9f72-7fb402ea74a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb67d8a4-c51a-4513-9f72-7fb402ea74a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87dd2f9-6189-40e5-bf0a-800be94c715f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87dd2f9-6189-40e5-bf0a-800be94c715f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '234eef1f-eb66-4ed1-ad77-0e884721f0f5', 'volume_name': 'volume-234eef1f-eb66-4ed1-ad77-0e884721f0f5', 'volume_size': 1, 'snapshot_id': '26a7e2ac-a73d-4da8-b115-a5ad08c4a546'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8469a50f-d292-4aeb-8003-03a8f7caf5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8469a50f-d292-4aeb-8003-03a8f7caf5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fb0993-207a-43a0-b747-6772d0266e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:39 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Volume 234eef1f-eb66-4ed1-ad77-0e884721f0f5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-234eef1f-eb66-4ed1-ad77-0e884721f0f5', 'volume_size': 1, 'snapshot_id': '26a7e2ac-a73d-4da8-b115-a5ad08c4a546'} Apr 29 17:38:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:40 devstack sudo[112294]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb" returned: 0 in 0.873s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] <== create_volume: return (2208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.211s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.374s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "cinder-quobyte-26a7e2ac-a73d-4da8-b115-a5ad08c4a546-234eef1f-eb66-4ed1-ad77-0e884721f0f5" by "_create_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-quobyte-26a7e2ac-a73d-4da8-b115-a5ad08c4a546-234eef1f-eb66-4ed1-ad77-0e884721f0f5" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Creating volume 234eef1f-eb66-4ed1-ad77-0e884721f0f5 from snapshot 26a7e2ac-a73d-4da8-b115-a5ad08c4a546 {{(pid=84547) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "cinder-quobyte-234eef1f-eb66-4ed1-ad77-0e884721f0f5" by "_copy_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Attempting download of 06eaa17c-152f-44a0-aade-7d2dda1abde4 ((None, [{'url': 'file:///opt/stack/data/glance/images/06eaa17c-152f-44a0-aade-7d2dda1abde4', 'metadata': {}}])) to volume 2afba920-2b67-47f3-b1b7-169d10b66adb. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-quobyte-234eef1f-eb66-4ed1-ad77-0e884721f0f5" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] snapshot: 26a7e2ac-a73d-4da8-b115-a5ad08c4a546, volume: 234eef1f-eb66-4ed1-ad77-0e884721f0f5, {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[c150b54d-fc2b-4835-b759-2ab2e5e46d8f]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93f2819-9aaf-4866-a051-b9cbf57bd18b]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_06eaa17c-152f-44a0-aade-7d2dda1abde4_k4p0j1s0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:40 devstack sudo[112302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_06eaa17c-152f-44a0-aade-7d2dda1abde4_k4p0j1s0 Apr 29 17:38:40 devstack sudo[112302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:40 devstack sudo[112300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546 Apr 29 17:38:40 devstack sudo[112300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:40 devstack sudo[112296]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4c7dc9ad-e99c-4bd0-8772-d4d6d76dd35a tempest-CreateVolumesFromImageTest-1274051230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f10d9ae3-c112-47e3-bbea-1a364112d850" returned: 0 in 1.192s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4c7dc9ad-e99c-4bd0-8772-d4d6d76dd35a tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f10d9ae3-c112-47e3-bbea-1a364112d850 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:40 devstack sudo[112306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f10d9ae3-c112-47e3-bbea-1a364112d850 Apr 29 17:38:40 devstack sudo[112306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:41 devstack sudo[112300]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546" returned: 0 in 1.122s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:41 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61815d80-1383-4d92-8758-0722c75618f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:38:41 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 17:38:41 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Creating direct copy from snapshot {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 17:38:41 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccf7a2d-7583-4ed0-8f46-3b4c9b93eabd]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:41 devstack sudo[112302]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_06eaa17c-152f-44a0-aade-7d2dda1abde4_k4p0j1s0" returned: 0 in 1.240s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:41 devstack sudo[112306]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_06eaa17c-152f-44a0-aade-7d2dda1abde4_k4p0j1s0 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4c7dc9ad-e99c-4bd0-8772-d4d6d76dd35a tempest-CreateVolumesFromImageTest-1274051230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f10d9ae3-c112-47e3-bbea-1a364112d850" returned: 0 in 1.012s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:41 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4c7dc9ad-e99c-4bd0-8772-d4d6d76dd35a tempest-CreateVolumesFromImageTest-1274051230 None] Lock "cinder-quobyte-f10d9ae3-c112-47e3-bbea-1a364112d850" released by "delete_volume" :: held 2.281s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:41 devstack sudo[112315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 Apr 29 17:38:41 devstack sudo[112315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:41 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-4c7dc9ad-e99c-4bd0-8772-d4d6d76dd35a tempest-CreateVolumesFromImageTest-1274051230 None] Created reservations ['e72a91af-3114-4942-bdf9-256714874e20', '90f011c2-f5b3-4d06-a363-1aa32964f916', '39a59cf5-8ab1-4e2f-87b3-59c254f100f0', '209ed729-b3b3-40f4-a7b4-fc76000150db'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:38:41 devstack sudo[112316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_06eaa17c-152f-44a0-aade-7d2dda1abde4_k4p0j1s0 Apr 29 17:38:41 devstack sudo[112316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4c7dc9ad-e99c-4bd0-8772-d4d6d76dd35a tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4c7dc9ad-e99c-4bd0-8772-d4d6d76dd35a tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:41 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4c7dc9ad-e99c-4bd0-8772-d4d6d76dd35a tempest-CreateVolumesFromImageTest-1274051230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:41 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4c7dc9ad-e99c-4bd0-8772-d4d6d76dd35a tempest-CreateVolumesFromImageTest-1274051230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4c7dc9ad-e99c-4bd0-8772-d4d6d76dd35a tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4c7dc9ad-e99c-4bd0-8772-d4d6d76dd35a tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:41 devstack sudo[112319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:38:41 devstack sudo[112319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:42 devstack sudo[112315]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7" returned: 0 in 0.923s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:42 devstack cinder-volume[84547]: DEBUG cinder.utils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Path /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-234eef1f-eb66-4ed1-ad77-0e884721f0f5 not found in is_blk_device check {{(pid=84547) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 17:38:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-234eef1f-eb66-4ed1-ad77-0e884721f0f5 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:42 devstack sudo[112327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-234eef1f-eb66-4ed1-ad77-0e884721f0f5 Apr 29 17:38:42 devstack sudo[112327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:42 devstack sudo[112316]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_06eaa17c-152f-44a0-aade-7d2dda1abde4_k4p0j1s0" returned: 1 in 0.950s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_06eaa17c-152f-44a0-aade-7d2dda1abde4_k4p0j1s0' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:38:42 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ba857c-3e5e-4229-91de-df4839ca38ea]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4e7b3625-8abe-4752-afb1-ded17b608d7d tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "cinder-14067360-6470-40ad-aefc-2e3e8894ece6-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4e7b3625-8abe-4752-afb1-ded17b608d7d tempest-CreateVolumesFromImageTest-1274051230 None] Lock "cinder-14067360-6470-40ad-aefc-2e3e8894ece6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:42 devstack sudo[112319]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4e7b3625-8abe-4752-afb1-ded17b608d7d tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "cinder-quobyte-14067360-6470-40ad-aefc-2e3e8894ece6" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4c7dc9ad-e99c-4bd0-8772-d4d6d76dd35a tempest-CreateVolumesFromImageTest-1274051230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.902s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:42 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-4c7dc9ad-e99c-4bd0-8772-d4d6d76dd35a tempest-CreateVolumesFromImageTest-1274051230 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:38:42 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4c7dc9ad-e99c-4bd0-8772-d4d6d76dd35a tempest-CreateVolumesFromImageTest-1274051230 None] Deleted volume successfully. Apr 29 17:38:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4e7b3625-8abe-4752-afb1-ded17b608d7d tempest-CreateVolumesFromImageTest-1274051230 None] Lock "cinder-quobyte-14067360-6470-40ad-aefc-2e3e8894ece6" acquired by "delete_volume" :: waited 0.041s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:42 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[2667599d-5e9b-4e03-bc13-a3086a59a45f]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4e7b3625-8abe-4752-afb1-ded17b608d7d tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14067360-6470-40ad-aefc-2e3e8894ece6 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:42 devstack sudo[112330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD Apr 29 17:38:42 devstack sudo[112330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4c7dc9ad-e99c-4bd0-8772-d4d6d76dd35a tempest-CreateVolumesFromImageTest-1274051230 None] Lock "cinder-f10d9ae3-c112-47e3-bbea-1a364112d850-delete_volume" released by "delete_volume" :: held 3.695s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:42 devstack sudo[112332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14067360-6470-40ad-aefc-2e3e8894ece6 Apr 29 17:38:42 devstack sudo[112332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:43 devstack sudo[112330]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD" returned: 0 in 1.165s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:43 devstack sudo[112346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD Apr 29 17:38:43 devstack sudo[112346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:44 devstack sudo[112332]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4e7b3625-8abe-4752-afb1-ded17b608d7d tempest-CreateVolumesFromImageTest-1274051230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14067360-6470-40ad-aefc-2e3e8894ece6" returned: 0 in 1.811s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4e7b3625-8abe-4752-afb1-ded17b608d7d tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14067360-6470-40ad-aefc-2e3e8894ece6 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:44 devstack sudo[112351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14067360-6470-40ad-aefc-2e3e8894ece6 Apr 29 17:38:44 devstack sudo[112351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:45 devstack sudo[112346]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD" returned: 1 in 1.866s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:38:45 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] 06eaa17c-152f-44a0-aade-7d2dda1abde4 was raw, converting to raw {{(pid=84547) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 17:38:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:45 devstack sudo[112358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb Apr 29 17:38:45 devstack sudo[112358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:45 devstack sudo[112351]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4e7b3625-8abe-4752-afb1-ded17b608d7d tempest-CreateVolumesFromImageTest-1274051230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-14067360-6470-40ad-aefc-2e3e8894ece6" returned: 0 in 1.255s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:45 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4e7b3625-8abe-4752-afb1-ded17b608d7d tempest-CreateVolumesFromImageTest-1274051230 None] Lock "cinder-quobyte-14067360-6470-40ad-aefc-2e3e8894ece6" released by "delete_volume" :: held 3.158s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:46 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-4e7b3625-8abe-4752-afb1-ded17b608d7d tempest-CreateVolumesFromImageTest-1274051230 None] Created reservations ['68d02d3b-ff58-4d2c-9563-5547bfc6a4ea', 'b0224a73-7377-4425-9a0e-8a5eca2abe75', '14a111e6-f649-4e2e-b8e5-c295c1221284', '14de5617-1f9c-4bd8-b80f-5c40aba2b33b'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:38:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4e7b3625-8abe-4752-afb1-ded17b608d7d tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4e7b3625-8abe-4752-afb1-ded17b608d7d tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4e7b3625-8abe-4752-afb1-ded17b608d7d tempest-CreateVolumesFromImageTest-1274051230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:46 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-4e7b3625-8abe-4752-afb1-ded17b608d7d tempest-CreateVolumesFromImageTest-1274051230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-4e7b3625-8abe-4752-afb1-ded17b608d7d tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4e7b3625-8abe-4752-afb1-ded17b608d7d tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:46 devstack sudo[112360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:38:46 devstack sudo[112360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-388a54ef-0552-40d1-acb9-21bf5e39fab4 tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "cinder-155f720f-fce8-4b2d-8dce-4b12eb07ca04-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-388a54ef-0552-40d1-acb9-21bf5e39fab4 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "cinder-155f720f-fce8-4b2d-8dce-4b12eb07ca04-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-388a54ef-0552-40d1-acb9-21bf5e39fab4 tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "cinder-quobyte-155f720f-fce8-4b2d-8dce-4b12eb07ca04" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:46 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-388a54ef-0552-40d1-acb9-21bf5e39fab4 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "cinder-quobyte-155f720f-fce8-4b2d-8dce-4b12eb07ca04" acquired by "delete_volume" :: waited 0.043s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:46 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[331c7bc7-29d3-4a8a-bf8d-d022a960e312]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-388a54ef-0552-40d1-acb9-21bf5e39fab4 tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-155f720f-fce8-4b2d-8dce-4b12eb07ca04 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:47 devstack sudo[112364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-155f720f-fce8-4b2d-8dce-4b12eb07ca04 Apr 29 17:38:47 devstack sudo[112364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:47 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:38:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Flow 'volume_create_manager' (e3243721-ad1e-49ad-b725-a30bfdc0f0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72553962-a506-47c3-be51-c68bb3a97250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72553962-a506-47c3-be51-c68bb3a97250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1183428344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c6a61bb-3195-4093-9642-994eb0e66914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='039ad1bc1c0c495b821e4a8007d41695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:47Z,use_quota=True,user_id='cde9bba017654ba4a3e2ed3ab1455d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6be32e7-8be1-4430-ac66-ab4ac7e9c449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6be32e7-8be1-4430-ac66-ab4ac7e9c449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:47 devstack sudo[112358]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8cfd5e-2942-4f5d-80eb-2da594a15f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8cfd5e-2942-4f5d-80eb-2da594a15f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c6a61bb-3195-4093-9642-994eb0e66914', 'volume_name': 'volume-3c6a61bb-3195-4093-9642-994eb0e66914', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19813e3a-bea0-41e1-a210-d86868b72d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19813e3a-bea0-41e1-a210-d86868b72d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c0a409-939b-40a9-aee0-5c30d145031e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:47 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Volume 3c6a61bb-3195-4093-9642-994eb0e66914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c6a61bb-3195-4093-9642-994eb0e66914', 'volume_size': 1} Apr 29 17:38:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb" returned: 0 in 2.029s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:47 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_06eaa17c-152f-44a0-aade-7d2dda1abde4_fqopxu28devstack@QuobyteHD, size 0.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:38:47 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Converted 0.00 MB image at 0.00 MB/s Apr 29 17:38:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:47 devstack sudo[112369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb 1G Apr 29 17:38:47 devstack sudo[112369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:47 devstack sudo[112360]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-4e7b3625-8abe-4752-afb1-ded17b608d7d tempest-CreateVolumesFromImageTest-1274051230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.691s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:47 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-4e7b3625-8abe-4752-afb1-ded17b608d7d tempest-CreateVolumesFromImageTest-1274051230 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:38:47 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-4e7b3625-8abe-4752-afb1-ded17b608d7d tempest-CreateVolumesFromImageTest-1274051230 None] Deleted volume successfully. Apr 29 17:38:47 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-4e7b3625-8abe-4752-afb1-ded17b608d7d tempest-CreateVolumesFromImageTest-1274051230 None] Lock "cinder-14067360-6470-40ad-aefc-2e3e8894ece6-delete_volume" released by "delete_volume" :: held 5.366s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:48 devstack sudo[112364]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-388a54ef-0552-40d1-acb9-21bf5e39fab4 tempest-CreateVolumesFromImageTest-1274051230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-155f720f-fce8-4b2d-8dce-4b12eb07ca04" returned: 0 in 1.933s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-388a54ef-0552-40d1-acb9-21bf5e39fab4 tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-155f720f-fce8-4b2d-8dce-4b12eb07ca04 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:48 devstack sudo[112369]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb 1G" returned: 0 in 1.271s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:48 devstack sudo[112377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-155f720f-fce8-4b2d-8dce-4b12eb07ca04 Apr 29 17:38:48 devstack sudo[112377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:49 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[567c0691-8467-472c-bb92-e1d09af2592f]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:49 devstack sudo[112379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb Apr 29 17:38:49 devstack sudo[112379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:49 devstack sudo[112327]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-234eef1f-eb66-4ed1-ad77-0e884721f0f5" returned: 0 in 6.991s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:49 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1cfa93-da93-4168-bb89-61e4b634456a]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:49 devstack sudo[112381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 Apr 29 17:38:49 devstack sudo[112381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:49 devstack sudo[112377]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-388a54ef-0552-40d1-acb9-21bf5e39fab4 tempest-CreateVolumesFromImageTest-1274051230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-155f720f-fce8-4b2d-8dce-4b12eb07ca04" returned: 0 in 0.897s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:49 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-388a54ef-0552-40d1-acb9-21bf5e39fab4 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "cinder-quobyte-155f720f-fce8-4b2d-8dce-4b12eb07ca04" released by "delete_volume" :: held 2.934s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:49 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-388a54ef-0552-40d1-acb9-21bf5e39fab4 tempest-CreateVolumesFromImageTest-1274051230 None] Created reservations ['8d795beb-7022-4f58-ab28-7bc4d6a30ae2', '51525903-b294-4ff0-9d1b-75ddcf1de640', 'e504a662-3db9-4055-b0f2-7b82106c3792', '1e2d7ee8-9ca0-4e30-bb06-e1a45670c3d2'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:38:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-388a54ef-0552-40d1-acb9-21bf5e39fab4 tempest-CreateVolumesFromImageTest-1274051230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-388a54ef-0552-40d1-acb9-21bf5e39fab4 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:49 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-388a54ef-0552-40d1-acb9-21bf5e39fab4 tempest-CreateVolumesFromImageTest-1274051230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:49 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-388a54ef-0552-40d1-acb9-21bf5e39fab4 tempest-CreateVolumesFromImageTest-1274051230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-388a54ef-0552-40d1-acb9-21bf5e39fab4 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-388a54ef-0552-40d1-acb9-21bf5e39fab4 tempest-CreateVolumesFromImageTest-1274051230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:49 devstack sudo[112386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:38:49 devstack sudo[112386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:49 devstack sudo[112379]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb" returned: 0 in 0.959s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:50 devstack sudo[112388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb Apr 29 17:38:50 devstack sudo[112388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:50 devstack sudo[112381]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7" returned: 0 in 0.986s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:50 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7, size 1024.00 MB, duration 6.99 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-234eef1f-eb66-4ed1-ad77-0e884721f0f5 {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:38:50 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Converted 1024.00 MB image at 146.45 MB/s Apr 29 17:38:50 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-234eef1f-eb66-4ed1-ad77-0e884721f0f5 is being set with open permissions: ugo+rw Apr 29 17:38:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-234eef1f-eb66-4ed1-ad77-0e884721f0f5 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:50 devstack sudo[112394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-234eef1f-eb66-4ed1-ad77-0e884721f0f5 Apr 29 17:38:50 devstack sudo[112394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:50 devstack sudo[112386]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-388a54ef-0552-40d1-acb9-21bf5e39fab4 tempest-CreateVolumesFromImageTest-1274051230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.736s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:50 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-388a54ef-0552-40d1-acb9-21bf5e39fab4 tempest-CreateVolumesFromImageTest-1274051230 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:38:50 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-388a54ef-0552-40d1-acb9-21bf5e39fab4 tempest-CreateVolumesFromImageTest-1274051230 None] Deleted volume successfully. Apr 29 17:38:50 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-388a54ef-0552-40d1-acb9-21bf5e39fab4 tempest-CreateVolumesFromImageTest-1274051230 None] Lock "cinder-155f720f-fce8-4b2d-8dce-4b12eb07ca04-delete_volume" released by "delete_volume" :: held 4.070s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:50 devstack sudo[112388]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb" returned: 1 in 0.842s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:38:50 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Downloaded image 06eaa17c-152f-44a0-aade-7d2dda1abde4 ((None, [{'url': 'file:///opt/stack/data/glance/images/06eaa17c-152f-44a0-aade-7d2dda1abde4', 'metadata': {}}])) to volume 2afba920-2b67-47f3-b1b7-169d10b66adb successfully. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 17:38:50 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Temporary image 06eaa17c-152f-44a0-aade-7d2dda1abde4 for user 2e24dde265854266a4dc5a3cf6ce3e63 is deleted. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 17:38:50 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Marking volume 2afba920-2b67-47f3-b1b7-169d10b66adb as bootable. {{(pid=84547) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 17:38:50 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Copying metadata from image 06eaa17c-152f-44a0-aade-7d2dda1abde4 to 2afba920-2b67-47f3-b1b7-169d10b66adb. {{(pid=84547) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 17:38:50 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Creating volume glance metadata for volume 2afba920-2b67-47f3-b1b7-169d10b66adb backed by image 06eaa17c-152f-44a0-aade-7d2dda1abde4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '06eaa17c-152f-44a0-aade-7d2dda1abde4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9c3ce9fb9008ef5b603b9280976f0ed6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84547) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 17:38:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59b5265-f3bd-4906-9ea8-5d3eda968212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2afba920-2b67-47f3-b1b7-169d10b66adb', 'volume_size': 1, 'image_id': '06eaa17c-152f-44a0-aade-7d2dda1abde4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/06eaa17c-152f-44a0-aade-7d2dda1abde4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c3ce9fb9008ef5b603b9280976f0ed6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ef2110a984f7497eba5314bd89eb4594', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '58681a7f4c849f6073c47af2e266520697d913af0733840a536fd1d9eff2d9f868154391a1f2283d7e5f0dd58d6f962f3d7f355b8877fa047397fa0d7271e63e', 'id': '06eaa17c-152f-44a0-aade-7d2dda1abde4', 'created_at': datetime.datetime(2026, 4, 29, 15, 38, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 38, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/06eaa17c-152f-44a0-aade-7d2dda1abde4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401eb621-b246-4f4e-8006-96593586931b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:50 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Volume volume-2afba920-2b67-47f3-b1b7-169d10b66adb (2afba920-2b67-47f3-b1b7-169d10b66adb): created successfully Apr 29 17:38:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401eb621-b246-4f4e-8006-96593586931b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Flow 'volume_create_manager' (3226247d-60ef-43dd-9b75-ce6c5de3e1a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:50 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e970b3d7-e6e5-454c-95c2-1c2437518cf2 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Created volume successfully. Apr 29 17:38:51 devstack sudo[112394]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-234eef1f-eb66-4ed1-ad77-0e884721f0f5" returned: 0 in 0.730s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-quobyte-234eef1f-eb66-4ed1-ad77-0e884721f0f5" released by "_copy_volume_from_snapshot" :: held 10.931s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-quobyte-26a7e2ac-a73d-4da8-b115-a5ad08c4a546-234eef1f-eb66-4ed1-ad77-0e884721f0f5" released by "_create_volume_from_snapshot" :: held 10.989s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.021s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.529s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1183428344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c6a61bb-3195-4093-9642-994eb0e66914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='039ad1bc1c0c495b821e4a8007d41695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:47Z,use_quota=True,user_id='cde9bba017654ba4a3e2ed3ab1455d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Creating volume 3c6a61bb-3195-4093-9642-994eb0e66914 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:38:51 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:51 devstack sudo[112401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 1073741824 Apr 29 17:38:51 devstack sudo[112401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fb0993-207a-43a0-b747-6772d0266e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-234eef1f-eb66-4ed1-ad77-0e884721f0f5', 'volume_size': 1, 'snapshot_id': '26a7e2ac-a73d-4da8-b115-a5ad08c4a546'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (610e5d9d-8379-489b-9f78-79e5f93509b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:51 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Volume volume-234eef1f-eb66-4ed1-ad77-0e884721f0f5 (234eef1f-eb66-4ed1-ad77-0e884721f0f5): created successfully Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (610e5d9d-8379-489b-9f78-79e5f93509b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Flow 'volume_create_manager' (37225982-abcb-4809-b04e-a193b1d81bf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Acquiring lock "cinder-2afba920-2b67-47f3-b1b7-169d10b66adb-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Lock "cinder-2afba920-2b67-47f3-b1b7-169d10b66adb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:51 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e3d191f2-ee9e-4157-a54b-04347da48365 tempest-VolumeDependencyTests-1128192403 None] Created volume successfully. Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Acquiring lock "cinder-quobyte-2afba920-2b67-47f3-b1b7-169d10b66adb" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Lock "cinder-quobyte-2afba920-2b67-47f3-b1b7-169d10b66adb" acquired by "delete_volume" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[1002cd3a-0e16-41cd-8dc4-ddfe64251f95]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:51 devstack sudo[112403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb Apr 29 17:38:51 devstack sudo[112403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:52 devstack sudo[112401]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "cinder-26a7e2ac-a73d-4da8-b115-a5ad08c4a546-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 1073741824" returned: 0 in 0.925s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-26a7e2ac-a73d-4da8-b115-a5ad08c4a546-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "cinder-quobyte-61815d80-1383-4d92-8758-0722c75618f7" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-quobyte-61815d80-1383-4d92-8758-0722c75618f7" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "cinder-quobyte-26a7e2ac-a73d-4da8-b115-a5ad08c4a546" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-quobyte-26a7e2ac-a73d-4da8-b115-a5ad08c4a546" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] Deleting offline snapshot 26a7e2ac-a73d-4da8-b115-a5ad08c4a546 of volume 61815d80-1383-4d92-8758-0722c75618f7 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:38:52 devstack sudo[112411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 Apr 29 17:38:52 devstack sudo[112411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] snapshot_file for this snap is: volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6ea282-1b72-4df5-8374-04584d35f9a7]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:52 devstack sudo[112403]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb" returned: 0 in 0.871s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:52 devstack sudo[112413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546 Apr 29 17:38:52 devstack sudo[112413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:52 devstack sudo[112414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb Apr 29 17:38:52 devstack sudo[112414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:52 devstack sudo[112411]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914" returned: 0 in 0.696s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c0a409-939b-40a9-aee0-5c30d145031e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c6a61bb-3195-4093-9642-994eb0e66914', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beda8985-3053-4108-95f6-4997e57c91d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:52 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Volume volume-3c6a61bb-3195-4093-9642-994eb0e66914 (3c6a61bb-3195-4093-9642-994eb0e66914): created successfully Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beda8985-3053-4108-95f6-4997e57c91d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Flow 'volume_create_manager' (e3243721-ad1e-49ad-b725-a30bfdc0f0a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:52 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-6459dfdd-f15f-4094-ac05-00206eb1fee5 tempest-SnapshotDependencyTests-786502227 None] Created volume successfully. Apr 29 17:38:53 devstack sudo[112413]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546" returned: 0 in 0.887s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61815d80-1383-4d92-8758-0722c75618f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff414859-6eff-4567-8967-ddb0c4e05109]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Flow 'volume_create_manager' (eb5b4f44-8f49-44a1-a486-fec26b89fc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0381d4-a637-4c66-8f7d-5af69e1d2b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e0381d4-a637-4c66-8f7d-5af69e1d2b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1827710587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18bcdf7-f1de-406d-a1c2-d7d2f886c52c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54c015bc0564ef6a4a77e3b52e3d4af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:53Z,use_quota=True,user_id='f0d990baaa414e88b32481ab181ffb59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb83621a-8c57-4fc5-8f3f-36b63c30fb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb83621a-8c57-4fc5-8f3f-36b63c30fb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48912f2e-d91a-46ff-a3c0-01c00ec96c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48912f2e-d91a-46ff-a3c0-01c00ec96c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f18bcdf7-f1de-406d-a1c2-d7d2f886c52c', 'volume_name': 'volume-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:53 devstack sudo[112425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 Apr 29 17:38:53 devstack sudo[112425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f7ff6c-59a9-4c03-ac6b-9efae5cec46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:53 devstack sudo[112414]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f7ff6c-59a9-4c03-ac6b-9efae5cec46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc54326-34cd-49f2-a3c4-4e1800b40a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:53 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Volume f18bcdf7-f1de-406d-a1c2-d7d2f886c52c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c', 'volume_size': 1} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1827710587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18bcdf7-f1de-406d-a1c2-d7d2f886c52c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54c015bc0564ef6a4a77e3b52e3d4af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:53Z,use_quota=True,user_id='f0d990baaa414e88b32481ab181ffb59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Creating volume f18bcdf7-f1de-406d-a1c2-d7d2f886c52c {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:38:53 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb" returned: 1 in 0.980s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:53 devstack sudo[112428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c 1073741824 Apr 29 17:38:53 devstack sudo[112428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:53 devstack sudo[112429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb Apr 29 17:38:53 devstack sudo[112429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:53 devstack sudo[112425]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7" returned: 0 in 0.829s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:53 devstack sudo[112440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546 Apr 29 17:38:53 devstack sudo[112440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f3731f55-add5-4cee-b0db-c3c27d5f8f22 tempest-SnapshotDependencyTests-786502227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:54 devstack sudo[112429]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2afba920-2b67-47f3-b1b7-169d10b66adb" returned: 0 in 0.778s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Lock "cinder-quobyte-2afba920-2b67-47f3-b1b7-169d10b66adb" released by "delete_volume" :: held 2.700s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Created reservations ['963cb81a-1d63-474d-9b1b-ce55be64ae6b', '169de176-3860-4e0c-bb3c-eaa3fb441381', '8255176c-0d40-4d56-85e2-a6f650a9be4f', 'ab952ac0-db01-454b-bd7e-f05ba0a0d629'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:38:54 devstack sudo[112428]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c 1073741824" returned: 0 in 0.969s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:54 devstack sudo[112442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:38:54 devstack sudo[112442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:54 devstack sudo[112444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c Apr 29 17:38:54 devstack sudo[112444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:54 devstack sudo[112440]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546" returned: 0 in 0.847s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:54 devstack sudo[112451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546 Apr 29 17:38:54 devstack sudo[112451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:54 devstack sudo[112442]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.692s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:38:54 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Deleted volume successfully. Apr 29 17:38:54 devstack sudo[112444]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dcfd55be-f0cb-450d-99a3-52c89a2196e3 tempest-VolumeAndVolumeTypeFromImageTest-421504943 None] Lock "cinder-2afba920-2b67-47f3-b1b7-169d10b66adb-delete_volume" released by "delete_volume" :: held 3.663s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c" returned: 0 in 0.685s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f3731f55-add5-4cee-b0db-c3c27d5f8f22 tempest-SnapshotDependencyTests-786502227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.911s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc54326-34cd-49f2-a3c4-4e1800b40a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:54 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1edbc60-f9fc-4865-88ca-e9894063cede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-f3731f55-add5-4cee-b0db-c3c27d5f8f22 tempest-SnapshotDependencyTests-786502227 None] Creating offline snapshot e77c79a9-0e25-45b7-ac06-198a05e25981 of volume 3c6a61bb-3195-4093-9642-994eb0e66914 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e4f455-b99c-4132-bf0e-0c1a0a303f40]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3731f55-add5-4cee-b0db-c3c27d5f8f22 tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:55 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Volume volume-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c (f18bcdf7-f1de-406d-a1c2-d7d2f886c52c): created successfully Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1edbc60-f9fc-4865-88ca-e9894063cede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Flow 'volume_create_manager' (eb5b4f44-8f49-44a1-a486-fec26b89fc92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:55 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-b5e73359-e425-4eab-a251-bdcdc698a7d2 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Created volume successfully. Apr 29 17:38:55 devstack sudo[112454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 Apr 29 17:38:55 devstack sudo[112454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:55 devstack sudo[112451]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7.26a7e2ac-a73d-4da8-b115-a5ad08c4a546" returned: 0 in 0.721s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-quobyte-26a7e2ac-a73d-4da8-b115-a5ad08c4a546" released by "_delete_snapshot" :: held 3.448s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-quobyte-61815d80-1383-4d92-8758-0722c75618f7" released by "delete_snapshot" :: held 3.507s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] Created reservations ['03af90d5-3af6-4006-85fe-203a9d1e3493', '3900ea00-3c7f-46f4-8c54-992cb5ce8840', '40cbecc5-4a97-43a9-b94c-ead717ffacc7', 'a872a617-3d26-4b72-9fda-63eee620d929'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Flow 'volume_create_manager' (2c9e434e-706e-42ba-93ae-448285232035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b38a77-959d-43a5-ba3b-05f3e4c899ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b38a77-959d-43a5-ba3b-05f3e4c899ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-631373372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9739d8a-42ba-4e3e-9830-415b3481e29a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54c015bc0564ef6a4a77e3b52e3d4af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:56Z,use_quota=True,user_id='f0d990baaa414e88b32481ab181ffb59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b108a6-6438-4a35-a46d-cc2e246f471f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64b108a6-6438-4a35-a46d-cc2e246f471f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6d1f8b-afdf-4911-9e53-20abc459aa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6d1f8b-afdf-4911-9e53-20abc459aa1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9739d8a-42ba-4e3e-9830-415b3481e29a', 'volume_name': 'volume-e9739d8a-42ba-4e3e-9830-415b3481e29a', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f10287-ed1c-4242-83a1-30c05bb24aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f10287-ed1c-4242-83a1-30c05bb24aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86fda2c6-c59e-4027-87c6-ea4cfa608db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:55 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Volume e9739d8a-42ba-4e3e-9830-415b3481e29a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9739d8a-42ba-4e3e-9830-415b3481e29a', 'volume_size': 1} Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:55 devstack sudo[112454]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3731f55-add5-4cee-b0db-c3c27d5f8f22 tempest-SnapshotDependencyTests-786502227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914" returned: 0 in 0.891s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3731f55-add5-4cee-b0db-c3c27d5f8f22 tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:55 devstack sudo[112460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981 1G Apr 29 17:38:55 devstack sudo[112460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:55 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] Delete snapshot completed successfully. Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-62d59b51-bb55-4d8f-a12e-5505b5f28b76 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-26a7e2ac-a73d-4da8-b115-a5ad08c4a546-delete_snapshot" released by "delete_snapshot" :: held 3.921s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Flow 'volume_create_manager' (48633392-b226-4345-bca0-1701fcbf5981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb8d1e1-5d43-452d-91e2-bcd05af5af24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb8d1e1-5d43-452d-91e2-bcd05af5af24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-760053661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc1e732c-4aa4-4a16-88ad-a11b48873035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54c015bc0564ef6a4a77e3b52e3d4af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:56Z,use_quota=True,user_id='f0d990baaa414e88b32481ab181ffb59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c90047-fdb8-42aa-95ed-acddcdc696a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c90047-fdb8-42aa-95ed-acddcdc696a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5037e7-e7ff-443e-b6d0-7803adb9c1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5037e7-e7ff-443e-b6d0-7803adb9c1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc1e732c-4aa4-4a16-88ad-a11b48873035', 'volume_name': 'volume-fc1e732c-4aa4-4a16-88ad-a11b48873035', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98234a47-c0c3-4607-a028-fb53f5b41721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98234a47-c0c3-4607-a028-fb53f5b41721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ccab22-c70d-4012-957c-593221dbdba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:56 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Volume fc1e732c-4aa4-4a16-88ad-a11b48873035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc1e732c-4aa4-4a16-88ad-a11b48873035', 'volume_size': 1} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-50a593d0-652e-4627-a9e8-439ce4e5ff52 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "cinder-61815d80-1383-4d92-8758-0722c75618f7-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-50a593d0-652e-4627-a9e8-439ce4e5ff52 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-61815d80-1383-4d92-8758-0722c75618f7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-50a593d0-652e-4627-a9e8-439ce4e5ff52 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "cinder-quobyte-61815d80-1383-4d92-8758-0722c75618f7" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-50a593d0-652e-4627-a9e8-439ce4e5ff52 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-quobyte-61815d80-1383-4d92-8758-0722c75618f7" acquired by "delete_volume" :: waited 0.023s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bb577f-9f2c-4073-8436-bdc2049437c7]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-50a593d0-652e-4627-a9e8-439ce4e5ff52 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:56 devstack sudo[112463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 Apr 29 17:38:56 devstack sudo[112463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Flow 'volume_create_manager' (c52c66e7-31db-4eb0-9a56-0d771f4ae1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d54983-d004-4985-9e76-3b83aa117ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d54983-d004-4985-9e76-3b83aa117ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-404034456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54c015bc0564ef6a4a77e3b52e3d4af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:57Z,use_quota=True,user_id='f0d990baaa414e88b32481ab181ffb59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c24a637-6892-4b55-86b2-3e0efd6cb5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c24a637-6892-4b55-86b2-3e0efd6cb5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af855795-bbb1-431e-9768-4ec2b4b68a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af855795-bbb1-431e-9768-4ec2b4b68a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac', 'volume_name': 'volume-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265124a4-fc3b-4f70-a266-388c8f58e48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (265124a4-fc3b-4f70-a266-388c8f58e48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38fdf06-97cf-4d3f-b739-6f9b9373cbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:56 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Volume 70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac', 'volume_size': 1} Apr 29 17:38:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:57 devstack sudo[112460]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3731f55-add5-4cee-b0db-c3c27d5f8f22 tempest-SnapshotDependencyTests-786502227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981 1G" returned: 0 in 1.140s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3731f55-add5-4cee-b0db-c3c27d5f8f22 tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c6a61bb-3195-4093-9642-994eb0e66914 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:57 devstack sudo[112470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c6a61bb-3195-4093-9642-994eb0e66914 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981 Apr 29 17:38:57 devstack sudo[112470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Flow 'volume_create_manager' (324b8aa4-bd7c-47db-9a2c-110db351dbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd16ce8-6fd5-41f5-879d-8ee925b14d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bd16ce8-6fd5-41f5-879d-8ee925b14d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2120726457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4657f438-9e23-4a56-aa6c-1d6533871157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54c015bc0564ef6a4a77e3b52e3d4af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:57Z,use_quota=True,user_id='f0d990baaa414e88b32481ab181ffb59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5abd3406-9a43-4c79-ad6d-e94aeb9b52bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5abd3406-9a43-4c79-ad6d-e94aeb9b52bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9072a323-21cc-48b9-bf44-e567715cc776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9072a323-21cc-48b9-bf44-e567715cc776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4657f438-9e23-4a56-aa6c-1d6533871157', 'volume_name': 'volume-4657f438-9e23-4a56-aa6c-1d6533871157', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc4d41e-70e8-4f97-a802-12b0acb0dc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc4d41e-70e8-4f97-a802-12b0acb0dc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec5d9b1-4ddd-4788-8245-5a6fcd434c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:57 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Volume 4657f438-9e23-4a56-aa6c-1d6533871157: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4657f438-9e23-4a56-aa6c-1d6533871157', 'volume_size': 1} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:57 devstack sudo[112463]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-50a593d0-652e-4627-a9e8-439ce4e5ff52 tempest-VolumeDependencyTests-1128192403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7" returned: 0 in 1.012s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-50a593d0-652e-4627-a9e8-439ce4e5ff52 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:57 devstack sudo[112475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7 Apr 29 17:38:57 devstack sudo[112475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Flow 'volume_create_manager' (774de869-0d9a-4d84-a494-9085758977f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df91505-9f5b-4592-98c0-32e985c59ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df91505-9f5b-4592-98c0-32e985c59ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2017503486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb37a7b-ee09-4117-8d0f-dd290ddbf435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54c015bc0564ef6a4a77e3b52e3d4af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:58Z,use_quota=True,user_id='f0d990baaa414e88b32481ab181ffb59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bc8055-a928-4750-b568-1b3a4db447ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bc8055-a928-4750-b568-1b3a4db447ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (853da2c8-7a68-4efc-a802-76cf2e798895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (853da2c8-7a68-4efc-a802-76cf2e798895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bb37a7b-ee09-4117-8d0f-dd290ddbf435', 'volume_name': 'volume-2bb37a7b-ee09-4117-8d0f-dd290ddbf435', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63283055-89f6-4c55-b3b6-cb540ae42626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63283055-89f6-4c55-b3b6-cb540ae42626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9baaa07c-5264-4d52-91f1-2f8c96a5f1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:57 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Volume 2bb37a7b-ee09-4117-8d0f-dd290ddbf435: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bb37a7b-ee09-4117-8d0f-dd290ddbf435', 'volume_size': 1} Apr 29 17:38:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:58 devstack sudo[112470]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3731f55-add5-4cee-b0db-c3c27d5f8f22 tempest-SnapshotDependencyTests-786502227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c6a61bb-3195-4093-9642-994eb0e66914 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981" returned: 0 in 1.105s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:58 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-f3731f55-add5-4cee-b0db-c3c27d5f8f22 tempest-SnapshotDependencyTests-786502227 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981 is being set with open permissions: ugo+rw Apr 29 17:38:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3731f55-add5-4cee-b0db-c3c27d5f8f22 tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:58 devstack sudo[112481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981 Apr 29 17:38:58 devstack sudo[112481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:58 devstack sudo[112475]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-50a593d0-652e-4627-a9e8-439ce4e5ff52 tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-61815d80-1383-4d92-8758-0722c75618f7" returned: 0 in 0.786s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-50a593d0-652e-4627-a9e8-439ce4e5ff52 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-quobyte-61815d80-1383-4d92-8758-0722c75618f7" released by "delete_volume" :: held 1.873s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:58 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-50a593d0-652e-4627-a9e8-439ce4e5ff52 tempest-VolumeDependencyTests-1128192403 None] Created reservations ['53209753-0127-4fc0-8a4d-f9c7150431f1', 'adac1e05-1d97-4627-a92d-7ca696d8b22a', '2c0c0d87-5d03-4cde-8a34-33d4ba639847', '30dc31be-ccde-44c2-81dd-ae14a838b91e'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:38:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-50a593d0-652e-4627-a9e8-439ce4e5ff52 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-50a593d0-652e-4627-a9e8-439ce4e5ff52 tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:38:58 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-50a593d0-652e-4627-a9e8-439ce4e5ff52 tempest-VolumeDependencyTests-1128192403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:38:58 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-50a593d0-652e-4627-a9e8-439ce4e5ff52 tempest-VolumeDependencyTests-1128192403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:38:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-50a593d0-652e-4627-a9e8-439ce4e5ff52 tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:38:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-50a593d0-652e-4627-a9e8-439ce4e5ff52 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:58 devstack sudo[112484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:38:58 devstack sudo[112484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:58 devstack sudo[112481]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3731f55-add5-4cee-b0db-c3c27d5f8f22 tempest-SnapshotDependencyTests-786502227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981" returned: 0 in 0.805s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3731f55-add5-4cee-b0db-c3c27d5f8f22 tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:59 devstack sudo[112487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.info Apr 29 17:38:59 devstack sudo[112487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Flow 'volume_create_manager' (f8a605b7-85e8-4023-ada2-8e8e1e6f5aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab7b870-4eba-48df-b7d5-23239d563add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dab7b870-4eba-48df-b7d5-23239d563add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-592018706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c91c9e3-85ce-41e9-b463-15a5dca790af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70949296e4c240ee8cf4ae44dd8cb2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:59Z,use_quota=True,user_id='af865355ad63453da440aa8fe58f2de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e0be400-c753-4a06-b821-e95d606d7e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:59 devstack sudo[112484]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e0be400-c753-4a06-b821-e95d606d7e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f995af57-dea3-47ca-8662-3ffebc87fa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f995af57-dea3-47ca-8662-3ffebc87fa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c91c9e3-85ce-41e9-b463-15a5dca790af', 'volume_name': 'volume-2c91c9e3-85ce-41e9-b463-15a5dca790af', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a8cbbe-5539-4a3f-8363-3f2d83ecc374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a8cbbe-5539-4a3f-8363-3f2d83ecc374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27be9abf-42ca-4cd9-9635-4572d16ef504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:38:59 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Volume 2c91c9e3-85ce-41e9-b463-15a5dca790af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c91c9e3-85ce-41e9-b463-15a5dca790af', 'volume_size': 1} Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-50a593d0-652e-4627-a9e8-439ce4e5ff52 tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.826s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-50a593d0-652e-4627-a9e8-439ce4e5ff52 tempest-VolumeDependencyTests-1128192403 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:38:59 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-50a593d0-652e-4627-a9e8-439ce4e5ff52 tempest-VolumeDependencyTests-1128192403 None] Deleted volume successfully. Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-50a593d0-652e-4627-a9e8-439ce4e5ff52 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-61815d80-1383-4d92-8758-0722c75618f7-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:38:59 devstack sudo[112487]: pam_unix(sudo:session): session closed for user root Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3731f55-add5-4cee-b0db-c3c27d5f8f22 tempest-SnapshotDependencyTests-786502227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.info" returned: 0 in 0.667s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:38:59 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-f3731f55-add5-4cee-b0db-c3c27d5f8f22 tempest-SnapshotDependencyTests-786502227 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.info is being set with open permissions: ugo+rw Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3731f55-add5-4cee-b0db-c3c27d5f8f22 tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:38:59 devstack sudo[112493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.info Apr 29 17:38:59 devstack sudo[112493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Flow 'volume_create_manager' (c5bb709c-583f-445d-8dc1-1b71b67fd9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:38:59 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb7c52c-f0b7-4546-a359-86023cdcf882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb7c52c-f0b7-4546-a359-86023cdcf882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-402849492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5984b101-9c7e-4183-8df5-4b36e4df75e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d830a9fd054105a07e646594e3ee88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:39:00Z,use_quota=True,user_id='387c837bb49e44848af8f6f7e7bfcf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6466dc1a-a69c-476c-9ed1-926b183e5bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6466dc1a-a69c-476c-9ed1-926b183e5bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5ea8c2-e360-449f-93a4-2b05969e246d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5ea8c2-e360-449f-93a4-2b05969e246d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5984b101-9c7e-4183-8df5-4b36e4df75e4', 'volume_name': 'volume-5984b101-9c7e-4183-8df5-4b36e4df75e4', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade57644-e62a-4563-800b-384de012d6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade57644-e62a-4563-800b-384de012d6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e2b9456-7d4c-4b6e-abed-785c5743eb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:00 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Volume 5984b101-9c7e-4183-8df5-4b36e4df75e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5984b101-9c7e-4183-8df5-4b36e4df75e4', 'volume_size': 1} Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:00 devstack sudo[112493]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3731f55-add5-4cee-b0db-c3c27d5f8f22 tempest-SnapshotDependencyTests-786502227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.info" returned: 0 in 0.631s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f3731f55-add5-4cee-b0db-c3c27d5f8f22 tempest-SnapshotDependencyTests-786502227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.371s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.474s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-631373372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9739d8a-42ba-4e3e-9830-415b3481e29a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54c015bc0564ef6a4a77e3b52e3d4af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:56Z,use_quota=True,user_id='f0d990baaa414e88b32481ab181ffb59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Creating volume e9739d8a-42ba-4e3e-9830-415b3481e29a {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:39:00 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:39:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9739d8a-42ba-4e3e-9830-415b3481e29a 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:00 devstack sudo[112496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9739d8a-42ba-4e3e-9830-415b3481e29a 1073741824 Apr 29 17:39:00 devstack sudo[112496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:00 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f3731f55-add5-4cee-b0db-c3c27d5f8f22 tempest-SnapshotDependencyTests-786502227 None] Create snapshot completed successfully Apr 29 17:39:01 devstack sudo[112496]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9739d8a-42ba-4e3e-9830-415b3481e29a 1073741824" returned: 0 in 0.771s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9739d8a-42ba-4e3e-9830-415b3481e29a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:01 devstack sudo[112502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9739d8a-42ba-4e3e-9830-415b3481e29a Apr 29 17:39:01 devstack sudo[112502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:01 devstack sudo[112502]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9739d8a-42ba-4e3e-9830-415b3481e29a" returned: 0 in 0.599s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.370s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-760053661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc1e732c-4aa4-4a16-88ad-a11b48873035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54c015bc0564ef6a4a77e3b52e3d4af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:56Z,use_quota=True,user_id='f0d990baaa414e88b32481ab181ffb59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Creating volume fc1e732c-4aa4-4a16-88ad-a11b48873035 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:39:01 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc1e732c-4aa4-4a16-88ad-a11b48873035 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86fda2c6-c59e-4027-87c6-ea4cfa608db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9739d8a-42ba-4e3e-9830-415b3481e29a', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:01 devstack sudo[112505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc1e732c-4aa4-4a16-88ad-a11b48873035 1073741824 Apr 29 17:39:01 devstack sudo[112505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c4b83a-6c6a-4b49-a242-e32a2f568793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:01 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Volume volume-e9739d8a-42ba-4e3e-9830-415b3481e29a (e9739d8a-42ba-4e3e-9830-415b3481e29a): created successfully Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c4b83a-6c6a-4b49-a242-e32a2f568793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Flow 'volume_create_manager' (2c9e434e-706e-42ba-93ae-448285232035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:39:01 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-141c022c-ac7e-4abd-b8f3-99458a87fe48 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Created volume successfully. Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Flow 'volume_create_manager' (0ccb158f-fcf2-4e3c-afcf-6ddbf442e8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7cc26d-b1d0-4dfa-a750-f7304cf8a4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed7cc26d-b1d0-4dfa-a750-f7304cf8a4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3af48036-5ac9-4af0-bae1-ecb7c24f1238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='039ad1bc1c0c495b821e4a8007d41695',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e77c79a9-0e25-45b7-ac06-198a05e25981,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:39:02Z,use_quota=True,user_id='cde9bba017654ba4a3e2ed3ab1455d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603c97ce-ec1a-4dde-84c1-a4adc826d4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603c97ce-ec1a-4dde-84c1-a4adc826d4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc311b68-777e-4538-a3dd-5855be261181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc311b68-777e-4538-a3dd-5855be261181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3af48036-5ac9-4af0-bae1-ecb7c24f1238', 'volume_name': 'volume-3af48036-5ac9-4af0-bae1-ecb7c24f1238', 'volume_size': 1, 'snapshot_id': 'e77c79a9-0e25-45b7-ac06-198a05e25981'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3747cc0-5a90-447e-beae-e9ec79726f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3747cc0-5a90-447e-beae-e9ec79726f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc24bf92-eec5-4ce6-8210-4ab4516a534d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:01 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Volume 3af48036-5ac9-4af0-bae1-ecb7c24f1238: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3af48036-5ac9-4af0-bae1-ecb7c24f1238', 'volume_size': 1, 'snapshot_id': 'e77c79a9-0e25-45b7-ac06-198a05e25981'} Apr 29 17:39:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:02 devstack sudo[112505]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc1e732c-4aa4-4a16-88ad-a11b48873035 1073741824" returned: 0 in 0.780s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc1e732c-4aa4-4a16-88ad-a11b48873035 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:02 devstack sudo[112511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc1e732c-4aa4-4a16-88ad-a11b48873035 Apr 29 17:39:02 devstack sudo[112511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:03 devstack sudo[112511]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc1e732c-4aa4-4a16-88ad-a11b48873035" returned: 0 in 0.595s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:39:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.263s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-404034456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54c015bc0564ef6a4a77e3b52e3d4af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:57Z,use_quota=True,user_id='f0d990baaa414e88b32481ab181ffb59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:39:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Creating volume 70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:39:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:39:03 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:39:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ccab22-c70d-4012-957c-593221dbdba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc1e732c-4aa4-4a16-88ad-a11b48873035', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:03 devstack sudo[112514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac 1073741824 Apr 29 17:39:03 devstack sudo[112514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad87c81e-1ae1-480e-8edf-195082a1709f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:03 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Volume volume-fc1e732c-4aa4-4a16-88ad-a11b48873035 (fc1e732c-4aa4-4a16-88ad-a11b48873035): created successfully Apr 29 17:39:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad87c81e-1ae1-480e-8edf-195082a1709f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:03 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Flow 'volume_create_manager' (48633392-b226-4345-bca0-1701fcbf5981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:03 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-03d4dbf9-d1ab-44b4-b016-9b73a15aa7e3 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Created volume successfully. Apr 29 17:39:03 devstack sudo[112514]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac 1073741824" returned: 0 in 0.785s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:04 devstack sudo[112520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac Apr 29 17:39:04 devstack sudo[112520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:04 devstack sudo[112520]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac" returned: 0 in 0.595s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:04 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:39:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.205s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:04 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2120726457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4657f438-9e23-4a56-aa6c-1d6533871157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54c015bc0564ef6a4a77e3b52e3d4af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:57Z,use_quota=True,user_id='f0d990baaa414e88b32481ab181ffb59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:39:04 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Creating volume 4657f438-9e23-4a56-aa6c-1d6533871157 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:39:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:04 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:04 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:04 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:39:04 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:39:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4657f438-9e23-4a56-aa6c-1d6533871157 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:04 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38fdf06-97cf-4d3f-b739-6f9b9373cbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:04 devstack sudo[112523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4657f438-9e23-4a56-aa6c-1d6533871157 1073741824 Apr 29 17:39:04 devstack sudo[112523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:04 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68249210-857f-488c-a58e-b2c5945b757d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:04 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Volume volume-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac (70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac): created successfully Apr 29 17:39:04 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68249210-857f-488c-a58e-b2c5945b757d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:04 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Flow 'volume_create_manager' (c52c66e7-31db-4eb0-9a56-0d771f4ae1c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:04 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-29000846-2028-4e18-9c6a-f73ce562c953 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Created volume successfully. Apr 29 17:39:05 devstack sudo[112523]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4657f438-9e23-4a56-aa6c-1d6533871157 1073741824" returned: 0 in 0.803s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4657f438-9e23-4a56-aa6c-1d6533871157 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:05 devstack sudo[112529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4657f438-9e23-4a56-aa6c-1d6533871157 Apr 29 17:39:05 devstack sudo[112529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:39:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:05 devstack sudo[112531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:39:05 devstack sudo[112531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:06 devstack sudo[112529]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4657f438-9e23-4a56-aa6c-1d6533871157" returned: 0 in 0.605s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.159s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2017503486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb37a7b-ee09-4117-8d0f-dd290ddbf435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d54c015bc0564ef6a4a77e3b52e3d4af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:58Z,use_quota=True,user_id='f0d990baaa414e88b32481ab181ffb59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Creating volume 2bb37a7b-ee09-4117-8d0f-dd290ddbf435 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:39:06 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2bb37a7b-ee09-4117-8d0f-dd290ddbf435 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:06 devstack sudo[112534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2bb37a7b-ee09-4117-8d0f-dd290ddbf435 1073741824 Apr 29 17:39:06 devstack sudo[112534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec5d9b1-4ddd-4788-8245-5a6fcd434c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4657f438-9e23-4a56-aa6c-1d6533871157', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63411797-e915-4dcf-a183-bab0fa39b5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:06 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Volume volume-4657f438-9e23-4a56-aa6c-1d6533871157 (4657f438-9e23-4a56-aa6c-1d6533871157): created successfully Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63411797-e915-4dcf-a183-bab0fa39b5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Flow 'volume_create_manager' (324b8aa4-bd7c-47db-9a2c-110db351dbe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:06 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-52365fab-76e0-4a30-8c48-bde8d7d86079 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Created volume successfully. Apr 29 17:39:06 devstack sudo[112531]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.629s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:39:06 devstack sudo[112534]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2bb37a7b-ee09-4117-8d0f-dd290ddbf435 1073741824" returned: 0 in 0.757s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2bb37a7b-ee09-4117-8d0f-dd290ddbf435 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:06 devstack sudo[112541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2bb37a7b-ee09-4117-8d0f-dd290ddbf435 Apr 29 17:39:06 devstack sudo[112541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:07 devstack sudo[112541]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2bb37a7b-ee09-4117-8d0f-dd290ddbf435" returned: 0 in 0.608s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] <== create_volume: return (1403ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:39:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.173s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-592018706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c91c9e3-85ce-41e9-b463-15a5dca790af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70949296e4c240ee8cf4ae44dd8cb2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:38:59Z,use_quota=True,user_id='af865355ad63453da440aa8fe58f2de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:39:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Creating volume 2c91c9e3-85ce-41e9-b463-15a5dca790af {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:39:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:07 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:39:07 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:39:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9baaa07c-5264-4d52-91f1-2f8c96a5f1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bb37a7b-ee09-4117-8d0f-dd290ddbf435', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:07 devstack sudo[112579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af 1073741824 Apr 29 17:39:07 devstack sudo[112579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007c4311-5724-48d8-becc-afc551df6e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:07 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Volume volume-2bb37a7b-ee09-4117-8d0f-dd290ddbf435 (2bb37a7b-ee09-4117-8d0f-dd290ddbf435): created successfully Apr 29 17:39:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007c4311-5724-48d8-becc-afc551df6e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:07 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Flow 'volume_create_manager' (774de869-0d9a-4d84-a494-9085758977f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:07 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-0fc704de-3477-42a2-bb26-9e4157a4ab55 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Created volume successfully. Apr 29 17:39:08 devstack sudo[112579]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af 1073741824" returned: 0 in 0.788s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:08 devstack sudo[112587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af Apr 29 17:39:08 devstack sudo[112587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-53d3296a-629f-4976-b7e4-0a10bd3ab4d7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "cinder-2bb37a7b-ee09-4117-8d0f-dd290ddbf435-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-53d3296a-629f-4976-b7e4-0a10bd3ab4d7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-2bb37a7b-ee09-4117-8d0f-dd290ddbf435-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-53d3296a-629f-4976-b7e4-0a10bd3ab4d7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "cinder-quobyte-2bb37a7b-ee09-4117-8d0f-dd290ddbf435" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-53d3296a-629f-4976-b7e4-0a10bd3ab4d7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-quobyte-2bb37a7b-ee09-4117-8d0f-dd290ddbf435" acquired by "delete_volume" :: waited 0.015s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[624b090e-d5fd-4ed0-9ddd-f54aeb936e8d]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-53d3296a-629f-4976-b7e4-0a10bd3ab4d7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2bb37a7b-ee09-4117-8d0f-dd290ddbf435 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:08 devstack sudo[112587]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af" returned: 0 in 0.640s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.934s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-402849492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5984b101-9c7e-4183-8df5-4b36e4df75e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d830a9fd054105a07e646594e3ee88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:39:00Z,use_quota=True,user_id='387c837bb49e44848af8f6f7e7bfcf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Creating volume 5984b101-9c7e-4183-8df5-4b36e4df75e4 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:39:08 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:39:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:09 devstack sudo[112596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2bb37a7b-ee09-4117-8d0f-dd290ddbf435 Apr 29 17:39:09 devstack sudo[112596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27be9abf-42ca-4cd9-9635-4572d16ef504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c91c9e3-85ce-41e9-b463-15a5dca790af', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:09 devstack sudo[112597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4 1073741824 Apr 29 17:39:09 devstack sudo[112597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632390c0-b373-49ab-a6ef-682f94a53117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:09 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Volume volume-2c91c9e3-85ce-41e9-b463-15a5dca790af (2c91c9e3-85ce-41e9-b463-15a5dca790af): created successfully Apr 29 17:39:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632390c0-b373-49ab-a6ef-682f94a53117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:09 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Flow 'volume_create_manager' (f8a605b7-85e8-4023-ada2-8e8e1e6f5aa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:09 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ec91443d-0b81-4196-b938-d2ddbf93b662 tempest-VolumeDependencyTests-1128192403 None] Created volume successfully. Apr 29 17:39:09 devstack sudo[112596]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-53d3296a-629f-4976-b7e4-0a10bd3ab4d7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2bb37a7b-ee09-4117-8d0f-dd290ddbf435" returned: 0 in 0.755s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-53d3296a-629f-4976-b7e4-0a10bd3ab4d7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2bb37a7b-ee09-4117-8d0f-dd290ddbf435 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:09 devstack sudo[112606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2bb37a7b-ee09-4117-8d0f-dd290ddbf435 Apr 29 17:39:09 devstack sudo[112606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:09 devstack sudo[112597]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4 1073741824" returned: 0 in 0.926s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:09 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:09 devstack sudo[112609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4 Apr 29 17:39:09 devstack sudo[112609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:39:10 devstack sudo[112606]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-53d3296a-629f-4976-b7e4-0a10bd3ab4d7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2bb37a7b-ee09-4117-8d0f-dd290ddbf435" returned: 0 in 0.763s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Flow 'volume_create_manager' (bac634f9-dc2f-43c6-bbe7-6840814cfbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec79d28-cbd0-4ae2-9c1e-6debf04d4e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-53d3296a-629f-4976-b7e4-0a10bd3ab4d7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-quobyte-2bb37a7b-ee09-4117-8d0f-dd290ddbf435" released by "delete_volume" :: held 1.606s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec79d28-cbd0-4ae2-9c1e-6debf04d4e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-3031196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b2be103-3369-46ec-8ed6-8bb8b58bf554,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70949296e4c240ee8cf4ae44dd8cb2cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=2c91c9e3-85ce-41e9-b463-15a5dca790af,status='creating',terminated_at=None,updated_at=2026-04-29T15:39:10Z,use_quota=True,user_id='af865355ad63453da440aa8fe58f2de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d2e84d-0ed0-4b8b-b64e-5da5e79d34d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91d2e84d-0ed0-4b8b-b64e-5da5e79d34d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4521df-bf0c-4009-ad1a-bd987d5081d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4521df-bf0c-4009-ad1a-bd987d5081d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1b2be103-3369-46ec-8ed6-8bb8b58bf554', 'volume_name': 'volume-1b2be103-3369-46ec-8ed6-8bb8b58bf554', 'volume_size': 1, 'source_volid': '2c91c9e3-85ce-41e9-b463-15a5dca790af', 'source_volstatus': 'available'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b051eecf-10a3-49b1-b1d8-7de202a7a76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b051eecf-10a3-49b1-b1d8-7de202a7a76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed6587a-5bba-4f8f-8ed4-d45bfdfa2395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:10 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Volume 1b2be103-3369-46ec-8ed6-8bb8b58bf554: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1b2be103-3369-46ec-8ed6-8bb8b58bf554', 'volume_size': 1, 'source_volid': '2c91c9e3-85ce-41e9-b463-15a5dca790af', 'source_volstatus': 'available'} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-53d3296a-629f-4976-b7e4-0a10bd3ab4d7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Created reservations ['2a35f9be-5745-4330-8471-b8d11d3aed32', '91386086-800d-4099-9a07-11d258607ca0', 'bb3b64d0-f5a7-4052-a37f-cdffb0988ea5', 'de25cd44-97a9-48a9-9c9b-cf7a6569be27'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-53d3296a-629f-4976-b7e4-0a10bd3ab4d7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-53d3296a-629f-4976-b7e4-0a10bd3ab4d7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-53d3296a-629f-4976-b7e4-0a10bd3ab4d7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-53d3296a-629f-4976-b7e4-0a10bd3ab4d7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-53d3296a-629f-4976-b7e4-0a10bd3ab4d7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-53d3296a-629f-4976-b7e4-0a10bd3ab4d7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:10 devstack sudo[112614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:39:10 devstack sudo[112614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:10 devstack sudo[112609]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4" returned: 0 in 0.804s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.797s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Acquiring lock "cinder-quobyte-e77c79a9-0e25-45b7-ac06-198a05e25981-3af48036-5ac9-4af0-bae1-ecb7c24f1238" by "_create_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e2b9456-7d4c-4b6e-abed-785c5743eb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5984b101-9c7e-4183-8df5-4b36e4df75e4', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53116bff-e805-4084-808c-4789e5b552f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Lock "cinder-quobyte-e77c79a9-0e25-45b7-ac06-198a05e25981-3af48036-5ac9-4af0-bae1-ecb7c24f1238" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Creating volume 3af48036-5ac9-4af0-bae1-ecb7c24f1238 from snapshot e77c79a9-0e25-45b7-ac06-198a05e25981 {{(pid=84547) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Acquiring lock "cinder-quobyte-3af48036-5ac9-4af0-bae1-ecb7c24f1238" by "_copy_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:10 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Volume volume-5984b101-9c7e-4183-8df5-4b36e4df75e4 (5984b101-9c7e-4183-8df5-4b36e4df75e4): created successfully Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53116bff-e805-4084-808c-4789e5b552f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Flow 'volume_create_manager' (c5bb709c-583f-445d-8dc1-1b71b67fd9ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Lock "cinder-quobyte-3af48036-5ac9-4af0-bae1-ecb7c24f1238" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] snapshot: e77c79a9-0e25-45b7-ac06-198a05e25981, volume: 3af48036-5ac9-4af0-bae1-ecb7c24f1238, {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 17:39:10 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-11be59a9-486a-4bd7-aacb-924289a18af4 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Created volume successfully. Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0166702-8156-4823-87c6-b16e10e79400]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:10 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:11 devstack sudo[112617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981 Apr 29 17:39:11 devstack sudo[112617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:11 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-18adb7ee-452c-4620-abfa-a4ce27ff9452 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "cinder-4657f438-9e23-4a56-aa6c-1d6533871157-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:11 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-18adb7ee-452c-4620-abfa-a4ce27ff9452 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-4657f438-9e23-4a56-aa6c-1d6533871157-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:11 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-18adb7ee-452c-4620-abfa-a4ce27ff9452 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "cinder-quobyte-4657f438-9e23-4a56-aa6c-1d6533871157" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:11 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-18adb7ee-452c-4620-abfa-a4ce27ff9452 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-quobyte-4657f438-9e23-4a56-aa6c-1d6533871157" acquired by "delete_volume" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:11 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f68a65-c69a-45f4-928a-8c862af6ff8f]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-18adb7ee-452c-4620-abfa-a4ce27ff9452 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4657f438-9e23-4a56-aa6c-1d6533871157 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:11 devstack sudo[112619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4657f438-9e23-4a56-aa6c-1d6533871157 Apr 29 17:39:11 devstack sudo[112619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:11 devstack sudo[112614]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-53d3296a-629f-4976-b7e4-0a10bd3ab4d7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.643s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:11 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-53d3296a-629f-4976-b7e4-0a10bd3ab4d7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:39:11 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-53d3296a-629f-4976-b7e4-0a10bd3ab4d7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Deleted volume successfully. Apr 29 17:39:11 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-53d3296a-629f-4976-b7e4-0a10bd3ab4d7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-2bb37a7b-ee09-4117-8d0f-dd290ddbf435-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:11 devstack sudo[112617]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981" returned: 0 in 0.828s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c6a61bb-3195-4093-9642-994eb0e66914(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:39:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 17:39:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Creating direct copy from snapshot {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 17:39:11 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[94adcaf1-83c5-4ef1-84b7-9786d5d601b8]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8ed34441-19d9-423c-a869-e1a57e3b0da5 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:11 devstack sudo[112626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 Apr 29 17:39:11 devstack sudo[112626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:11 devstack sudo[112619]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-18adb7ee-452c-4620-abfa-a4ce27ff9452 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4657f438-9e23-4a56-aa6c-1d6533871157" returned: 0 in 0.774s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-18adb7ee-452c-4620-abfa-a4ce27ff9452 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4657f438-9e23-4a56-aa6c-1d6533871157 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:11 devstack sudo[112630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4657f438-9e23-4a56-aa6c-1d6533871157 Apr 29 17:39:11 devstack sudo[112630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:12 devstack sudo[112626]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914" returned: 0 in 0.771s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:12 devstack cinder-volume[84547]: DEBUG cinder.utils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Path /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3af48036-5ac9-4af0-bae1-ecb7c24f1238 not found in is_blk_device check {{(pid=84547) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 17:39:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3af48036-5ac9-4af0-bae1-ecb7c24f1238 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:12 devstack sudo[112636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3af48036-5ac9-4af0-bae1-ecb7c24f1238 Apr 29 17:39:12 devstack sudo[112636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:12 devstack sudo[112630]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-18adb7ee-452c-4620-abfa-a4ce27ff9452 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-4657f438-9e23-4a56-aa6c-1d6533871157" returned: 0 in 0.639s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:12 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-18adb7ee-452c-4620-abfa-a4ce27ff9452 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-quobyte-4657f438-9e23-4a56-aa6c-1d6533871157" released by "delete_volume" :: held 1.461s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:12 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-18adb7ee-452c-4620-abfa-a4ce27ff9452 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Created reservations ['7ec42474-0ecc-4665-b94b-4c095d5e75ad', '564a3bad-5840-4964-9546-5e13f41fb003', '52a82c8f-6706-453f-9879-eef00719093a', '069dba21-4d40-4c08-aacd-ceea2c9bbc8b'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:39:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-18adb7ee-452c-4620-abfa-a4ce27ff9452 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-18adb7ee-452c-4620-abfa-a4ce27ff9452 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-18adb7ee-452c-4620-abfa-a4ce27ff9452 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:12 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-18adb7ee-452c-4620-abfa-a4ce27ff9452 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-18adb7ee-452c-4620-abfa-a4ce27ff9452 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-18adb7ee-452c-4620-abfa-a4ce27ff9452 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:12 devstack sudo[112638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:39:12 devstack sudo[112638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:13 devstack sudo[112638]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:13 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-84e89b2c-2016-4817-9e3b-5841a9f60d10 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "cinder-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-18adb7ee-452c-4620-abfa-a4ce27ff9452 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.777s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:13 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-18adb7ee-452c-4620-abfa-a4ce27ff9452 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:39:13 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-18adb7ee-452c-4620-abfa-a4ce27ff9452 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Deleted volume successfully. Apr 29 17:39:13 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-84e89b2c-2016-4817-9e3b-5841a9f60d10 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac-delete_volume" acquired by "delete_volume" :: waited 0.156s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:13 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-18adb7ee-452c-4620-abfa-a4ce27ff9452 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-4657f438-9e23-4a56-aa6c-1d6533871157-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:13 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-84e89b2c-2016-4817-9e3b-5841a9f60d10 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "cinder-quobyte-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:13 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-84e89b2c-2016-4817-9e3b-5841a9f60d10 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-quobyte-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac" acquired by "delete_volume" :: waited 0.025s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:13 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[034c26f9-9d9c-4715-88f4-116fb6235f5d]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-84e89b2c-2016-4817-9e3b-5841a9f60d10 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:14 devstack sudo[112651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac Apr 29 17:39:14 devstack sudo[112651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:15 devstack sudo[112651]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-84e89b2c-2016-4817-9e3b-5841a9f60d10 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac" returned: 0 in 1.275s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-84e89b2c-2016-4817-9e3b-5841a9f60d10 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:15 devstack sudo[112656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac Apr 29 17:39:15 devstack sudo[112656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:16 devstack sudo[112656]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-84e89b2c-2016-4817-9e3b-5841a9f60d10 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac" returned: 0 in 1.148s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:16 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-84e89b2c-2016-4817-9e3b-5841a9f60d10 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-quobyte-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac" released by "delete_volume" :: held 2.530s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:16 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-84e89b2c-2016-4817-9e3b-5841a9f60d10 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Created reservations ['0cc04894-db8d-418a-beb4-a037cf94a65d', '0f22b43f-2556-4cd3-8db6-de5600f2a4d2', '0e7d1648-1fb8-4ca1-b61b-07563bd47010', 'd1a09970-9235-41e2-9939-580498ab3232'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:39:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-84e89b2c-2016-4817-9e3b-5841a9f60d10 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-84e89b2c-2016-4817-9e3b-5841a9f60d10 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:16 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-84e89b2c-2016-4817-9e3b-5841a9f60d10 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:16 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-84e89b2c-2016-4817-9e3b-5841a9f60d10 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-84e89b2c-2016-4817-9e3b-5841a9f60d10 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-84e89b2c-2016-4817-9e3b-5841a9f60d10 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:16 devstack sudo[112659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:39:16 devstack sudo[112659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e7b44efe-3e2d-4a9d-8c18-dcd77a4534b7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "cinder-fc1e732c-4aa4-4a16-88ad-a11b48873035-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e7b44efe-3e2d-4a9d-8c18-dcd77a4534b7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-fc1e732c-4aa4-4a16-88ad-a11b48873035-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e7b44efe-3e2d-4a9d-8c18-dcd77a4534b7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "cinder-quobyte-fc1e732c-4aa4-4a16-88ad-a11b48873035" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:17 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e7b44efe-3e2d-4a9d-8c18-dcd77a4534b7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-quobyte-fc1e732c-4aa4-4a16-88ad-a11b48873035" acquired by "delete_volume" :: waited 0.035s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:17 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b00fba2-1131-480f-9f01-63f68d77de73]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e7b44efe-3e2d-4a9d-8c18-dcd77a4534b7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc1e732c-4aa4-4a16-88ad-a11b48873035 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:17 devstack sudo[112663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc1e732c-4aa4-4a16-88ad-a11b48873035 Apr 29 17:39:17 devstack sudo[112663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:17 devstack sudo[112636]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3af48036-5ac9-4af0-bae1-ecb7c24f1238" returned: 0 in 5.421s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:17 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e154fc-7fc8-4b96-86ad-545a4441e6d3]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:18 devstack sudo[112659]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-84e89b2c-2016-4817-9e3b-5841a9f60d10 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.327s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:18 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-84e89b2c-2016-4817-9e3b-5841a9f60d10 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:39:18 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-84e89b2c-2016-4817-9e3b-5841a9f60d10 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Deleted volume successfully. Apr 29 17:39:18 devstack sudo[112668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 Apr 29 17:39:18 devstack sudo[112668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:18 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-84e89b2c-2016-4817-9e3b-5841a9f60d10 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-70e87f02-a3d5-45f5-aa6e-8bcb92ba55ac-delete_volume" released by "delete_volume" :: held 4.450s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:18 devstack sudo[112663]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e7b44efe-3e2d-4a9d-8c18-dcd77a4534b7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc1e732c-4aa4-4a16-88ad-a11b48873035" returned: 0 in 0.796s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e7b44efe-3e2d-4a9d-8c18-dcd77a4534b7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc1e732c-4aa4-4a16-88ad-a11b48873035 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:18 devstack sudo[112673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc1e732c-4aa4-4a16-88ad-a11b48873035 Apr 29 17:39:18 devstack sudo[112673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:18 devstack sudo[112668]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914" returned: 0 in 0.951s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:18 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3af48036-5ac9-4af0-bae1-ecb7c24f1238 {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:39:18 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Converted 1024.00 MB image at 188.84 MB/s Apr 29 17:39:18 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3af48036-5ac9-4af0-bae1-ecb7c24f1238 is being set with open permissions: ugo+rw Apr 29 17:39:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3af48036-5ac9-4af0-bae1-ecb7c24f1238 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:18 devstack sudo[112678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3af48036-5ac9-4af0-bae1-ecb7c24f1238 Apr 29 17:39:18 devstack sudo[112678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:19 devstack sudo[112673]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e7b44efe-3e2d-4a9d-8c18-dcd77a4534b7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-fc1e732c-4aa4-4a16-88ad-a11b48873035" returned: 0 in 0.605s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e7b44efe-3e2d-4a9d-8c18-dcd77a4534b7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-quobyte-fc1e732c-4aa4-4a16-88ad-a11b48873035" released by "delete_volume" :: held 1.481s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-e7b44efe-3e2d-4a9d-8c18-dcd77a4534b7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Created reservations ['ff0092da-107a-40ba-8cb0-6c4702a54ed1', '21f67dfb-6852-481a-b190-5b1e9323c692', '43b8e54b-786b-47a6-b31e-dcf10c7bb6c5', '593e60f9-1bbe-4af8-b020-f227886e238e'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e7b44efe-3e2d-4a9d-8c18-dcd77a4534b7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e7b44efe-3e2d-4a9d-8c18-dcd77a4534b7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e7b44efe-3e2d-4a9d-8c18-dcd77a4534b7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e7b44efe-3e2d-4a9d-8c18-dcd77a4534b7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e7b44efe-3e2d-4a9d-8c18-dcd77a4534b7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e7b44efe-3e2d-4a9d-8c18-dcd77a4534b7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:19 devstack sudo[112681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:39:19 devstack sudo[112681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:19 devstack sudo[112678]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3af48036-5ac9-4af0-bae1-ecb7c24f1238" returned: 0 in 0.628s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Lock "cinder-quobyte-3af48036-5ac9-4af0-bae1-ecb7c24f1238" released by "_copy_volume_from_snapshot" :: held 8.718s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Lock "cinder-quobyte-e77c79a9-0e25-45b7-ac06-198a05e25981-3af48036-5ac9-4af0-bae1-ecb7c24f1238" released by "_create_volume_from_snapshot" :: held 8.776s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.819s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.021s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:19 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Cloning volume 2c91c9e3-85ce-41e9-b463-15a5dca790af to volume 1b2be103-3369-46ec-8ed6-8bb8b58bf554 Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc24bf92-eec5-4ce6-8210-4ab4516a534d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3af48036-5ac9-4af0-bae1-ecb7c24f1238', 'volume_size': 1, 'snapshot_id': 'e77c79a9-0e25-45b7-ac06-198a05e25981'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea999d6-d1d0-4f58-b20d-c71a4eda2631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=114,cinder:UPDATE=151,cinder:INSERT=38,cinder:DELETE=19 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Creating offline snapshot 2b0c8e07-806d-4f3e-8f70-e95968928f4c of volume 2c91c9e3-85ce-41e9-b463-15a5dca790af {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:39:19 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Volume volume-3af48036-5ac9-4af0-bae1-ecb7c24f1238 (3af48036-5ac9-4af0-bae1-ecb7c24f1238): created successfully Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea999d6-d1d0-4f58-b20d-c71a4eda2631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Flow 'volume_create_manager' (0ccb158f-fcf2-4e3c-afcf-6ddbf442e8bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[576ba144-b2d8-4fef-989d-70f853b6e988]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:19 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-81645b11-cb8b-4fa2-a422-838db62e9a54 tempest-SnapshotDependencyTests-786502227 None] Created volume successfully. Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-69d4de37-1b8c-4876-9531-db9265b0ae39 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "cinder-e9739d8a-42ba-4e3e-9830-415b3481e29a-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-69d4de37-1b8c-4876-9531-db9265b0ae39 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-e9739d8a-42ba-4e3e-9830-415b3481e29a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:19 devstack sudo[112684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af Apr 29 17:39:19 devstack sudo[112684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-69d4de37-1b8c-4876-9531-db9265b0ae39 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "cinder-quobyte-e9739d8a-42ba-4e3e-9830-415b3481e29a" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-69d4de37-1b8c-4876-9531-db9265b0ae39 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-quobyte-e9739d8a-42ba-4e3e-9830-415b3481e29a" acquired by "delete_volume" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d01e99-a93b-4625-b03e-e4542f879002]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-69d4de37-1b8c-4876-9531-db9265b0ae39 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9739d8a-42ba-4e3e-9830-415b3481e29a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:19 devstack sudo[112681]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e7b44efe-3e2d-4a9d-8c18-dcd77a4534b7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.641s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-e7b44efe-3e2d-4a9d-8c18-dcd77a4534b7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:39:19 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e7b44efe-3e2d-4a9d-8c18-dcd77a4534b7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Deleted volume successfully. Apr 29 17:39:19 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-e7b44efe-3e2d-4a9d-8c18-dcd77a4534b7 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-fc1e732c-4aa4-4a16-88ad-a11b48873035-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:20 devstack sudo[112687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9739d8a-42ba-4e3e-9830-415b3481e29a Apr 29 17:39:20 devstack sudo[112687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:20 devstack sudo[112684]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af" returned: 0 in 0.789s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:20 devstack sudo[112692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c 1G Apr 29 17:39:20 devstack sudo[112692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] Acquiring lock "cinder-e77c79a9-0e25-45b7-ac06-198a05e25981-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] Lock "cinder-e77c79a9-0e25-45b7-ac06-198a05e25981-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] Acquiring lock "cinder-quobyte-3c6a61bb-3195-4093-9642-994eb0e66914" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] Lock "cinder-quobyte-3c6a61bb-3195-4093-9642-994eb0e66914" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] Acquiring lock "cinder-quobyte-e77c79a9-0e25-45b7-ac06-198a05e25981" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] Lock "cinder-quobyte-e77c79a9-0e25-45b7-ac06-198a05e25981" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:20 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] Deleting offline snapshot e77c79a9-0e25-45b7-ac06-198a05e25981 of volume 3c6a61bb-3195-4093-9642-994eb0e66914 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:39:20 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] snapshot_file for this snap is: volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:39:20 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[385da325-885d-478b-992a-999c1b4bc24d]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:20 devstack sudo[112687]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-69d4de37-1b8c-4876-9531-db9265b0ae39 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9739d8a-42ba-4e3e-9830-415b3481e29a" returned: 0 in 0.796s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-69d4de37-1b8c-4876-9531-db9265b0ae39 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9739d8a-42ba-4e3e-9830-415b3481e29a {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:20 devstack sudo[112698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9739d8a-42ba-4e3e-9830-415b3481e29a Apr 29 17:39:20 devstack sudo[112698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:20 devstack sudo[112697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981 Apr 29 17:39:20 devstack sudo[112697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:21 devstack sudo[112692]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c 1G" returned: 0 in 0.787s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c91c9e3-85ce-41e9-b463-15a5dca790af -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:21 devstack sudo[112707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c91c9e3-85ce-41e9-b463-15a5dca790af -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c Apr 29 17:39:21 devstack sudo[112707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:21 devstack sudo[112698]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-69d4de37-1b8c-4876-9531-db9265b0ae39 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e9739d8a-42ba-4e3e-9830-415b3481e29a" returned: 0 in 0.664s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:21 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-69d4de37-1b8c-4876-9531-db9265b0ae39 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-quobyte-e9739d8a-42ba-4e3e-9830-415b3481e29a" released by "delete_volume" :: held 1.513s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:21 devstack sudo[112697]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981" returned: 0 in 0.762s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c6a61bb-3195-4093-9642-994eb0e66914(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:39:21 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=116,cinder:UPDATE=152,cinder:DELETE=11,cinder:INSERT=39 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:39:21 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d225949-ed27-4b80-8577-a05f802ed002]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:21 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-69d4de37-1b8c-4876-9531-db9265b0ae39 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Created reservations ['5a740c88-a434-48fe-833e-ee3096a23042', 'a12eac6d-a374-4150-a3a5-b87440a70d87', '90755615-31b4-49ec-9725-5b5c6bb74704', '0ed22689-d871-44c6-abc1-30c07a7eaa86'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:39:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-69d4de37-1b8c-4876-9531-db9265b0ae39 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-69d4de37-1b8c-4876-9531-db9265b0ae39 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-69d4de37-1b8c-4876-9531-db9265b0ae39 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-69d4de37-1b8c-4876-9531-db9265b0ae39 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-69d4de37-1b8c-4876-9531-db9265b0ae39 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-69d4de37-1b8c-4876-9531-db9265b0ae39 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:21 devstack sudo[112710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 Apr 29 17:39:21 devstack sudo[112710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:21 devstack sudo[112712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:39:21 devstack sudo[112712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:21 devstack sudo[112707]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c91c9e3-85ce-41e9-b463-15a5dca790af -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c" returned: 0 in 0.707s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:21 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c is being set with open permissions: ugo+rw Apr 29 17:39:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:21 devstack sudo[112717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c Apr 29 17:39:21 devstack sudo[112717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3b46b385-0ac4-4b38-a802-6824f1234f36 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "cinder-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3b46b385-0ac4-4b38-a802-6824f1234f36 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3b46b385-0ac4-4b38-a802-6824f1234f36 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "cinder-quobyte-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3b46b385-0ac4-4b38-a802-6824f1234f36 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-quobyte-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c" acquired by "delete_volume" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:22 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[9373aaa4-157e-4356-aa18-3c518281ed53]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3b46b385-0ac4-4b38-a802-6824f1234f36 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:22 devstack sudo[112721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c Apr 29 17:39:22 devstack sudo[112721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:22 devstack sudo[112712]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-69d4de37-1b8c-4876-9531-db9265b0ae39 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.747s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:22 devstack sudo[112710]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:22 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-69d4de37-1b8c-4876-9531-db9265b0ae39 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:39:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914" returned: 0 in 0.872s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:22 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-69d4de37-1b8c-4876-9531-db9265b0ae39 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Deleted volume successfully. Apr 29 17:39:22 devstack sudo[112725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981 Apr 29 17:39:22 devstack sudo[112725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:22 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-69d4de37-1b8c-4876-9531-db9265b0ae39 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-e9739d8a-42ba-4e3e-9830-415b3481e29a-delete_volume" released by "delete_volume" :: held 2.556s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:22 devstack sudo[112717]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c" returned: 0 in 0.674s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:22 devstack sudo[112728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.info Apr 29 17:39:22 devstack sudo[112728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:22 devstack sudo[112721]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3b46b385-0ac4-4b38-a802-6824f1234f36 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c" returned: 0 in 0.788s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3b46b385-0ac4-4b38-a802-6824f1234f36 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:22 devstack sudo[112736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c Apr 29 17:39:22 devstack sudo[112736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:23 devstack sudo[112725]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981" returned: 0 in 0.765s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:23 devstack sudo[112738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981 Apr 29 17:39:23 devstack sudo[112738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:23 devstack sudo[112728]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.info" returned: 0 in 0.688s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:23 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.info is being set with open permissions: ugo+rw Apr 29 17:39:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:23 devstack sudo[112741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.info Apr 29 17:39:23 devstack sudo[112741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:23 devstack sudo[112736]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3b46b385-0ac4-4b38-a802-6824f1234f36 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c" returned: 0 in 0.639s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3b46b385-0ac4-4b38-a802-6824f1234f36 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-quobyte-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c" released by "delete_volume" :: held 1.487s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:23 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-3b46b385-0ac4-4b38-a802-6824f1234f36 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Created reservations ['d6996926-b373-4fd7-b3bb-02567d165f09', '775c9491-a8f5-4adb-a88c-135796eb8f0b', 'f0fd8524-1575-4d19-b652-d8614c5fda45', '6e7da779-3302-4de4-8a26-2fd00250381c'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:39:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3b46b385-0ac4-4b38-a802-6824f1234f36 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3b46b385-0ac4-4b38-a802-6824f1234f36 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:23 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3b46b385-0ac4-4b38-a802-6824f1234f36 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:23 devstack sudo[112738]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:23 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3b46b385-0ac4-4b38-a802-6824f1234f36 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3b46b385-0ac4-4b38-a802-6824f1234f36 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3b46b385-0ac4-4b38-a802-6824f1234f36 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914.e77c79a9-0e25-45b7-ac06-198a05e25981" returned: 0 in 0.702s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:23 devstack sudo[112745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:39:23 devstack sudo[112745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] Lock "cinder-quobyte-e77c79a9-0e25-45b7-ac06-198a05e25981" released by "_delete_snapshot" :: held 3.223s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] Lock "cinder-quobyte-3c6a61bb-3195-4093-9642-994eb0e66914" released by "delete_snapshot" :: held 3.253s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:23 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] Created reservations ['e57a1501-6cae-465e-b25e-77300a70d385', 'dd6acfb8-1629-48a9-8796-e93d8ecffdfc', '2340b22a-d39c-48be-9085-5685f50a0712', '5afa9f3e-0453-47cc-9487-10778f871d3a'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:39:23 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] Delete snapshot completed successfully. Apr 29 17:39:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-6062ae3d-0db2-4d8c-85a6-315ee4d043ff tempest-SnapshotDependencyTests-786502227 None] Lock "cinder-e77c79a9-0e25-45b7-ac06-198a05e25981-delete_snapshot" released by "delete_snapshot" :: held 3.393s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:23 devstack sudo[112741]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.info" returned: 0 in 0.632s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "cinder-quobyte-1b2be103-3369-46ec-8ed6-8bb8b58bf554" by "_copy_volume_from_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-quobyte-1b2be103-3369-46ec-8ed6-8bb8b58bf554" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] snapshot: 2b0c8e07-806d-4f3e-8f70-e95968928f4c, volume: 1b2be103-3369-46ec-8ed6-8bb8b58bf554, {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[170d0dea-73ce-424a-b014-cd1ad883bdde]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:24 devstack sudo[112748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c Apr 29 17:39:24 devstack sudo[112748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:24 devstack sudo[112745]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3b46b385-0ac4-4b38-a802-6824f1234f36 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.626s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-3b46b385-0ac4-4b38-a802-6824f1234f36 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:39:24 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-3b46b385-0ac4-4b38-a802-6824f1234f36 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Deleted volume successfully. Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3b46b385-0ac4-4b38-a802-6824f1234f36 tempest-CreateVolumesFromSourceVolumeTest-191723745 None] Lock "cinder-f18bcdf7-f1de-406d-a1c2-d7d2f886c52c-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d43f890f-ae94-47bf-bfe5-d40caa142b8f tempest-SnapshotDependencyTests-786502227 None] Acquiring lock "cinder-3c6a61bb-3195-4093-9642-994eb0e66914-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:24 devstack sudo[112748]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d43f890f-ae94-47bf-bfe5-d40caa142b8f tempest-SnapshotDependencyTests-786502227 None] Lock "cinder-3c6a61bb-3195-4093-9642-994eb0e66914-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c" returned: 0 in 0.792s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c91c9e3-85ce-41e9-b463-15a5dca790af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Creating direct copy from snapshot {{(pid=84547) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0dbd7d0-b581-464d-85d0-4d4fa2e09755]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d43f890f-ae94-47bf-bfe5-d40caa142b8f tempest-SnapshotDependencyTests-786502227 None] Acquiring lock "cinder-quobyte-3c6a61bb-3195-4093-9642-994eb0e66914" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:24 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d43f890f-ae94-47bf-bfe5-d40caa142b8f tempest-SnapshotDependencyTests-786502227 None] Lock "cinder-quobyte-3c6a61bb-3195-4093-9642-994eb0e66914" acquired by "delete_volume" :: waited 0.041s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:25 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81f96de-317d-418e-9854-7e23d32c1c91]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d43f890f-ae94-47bf-bfe5-d40caa142b8f tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:25 devstack sudo[112755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af Apr 29 17:39:25 devstack sudo[112755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:25 devstack sudo[112757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 Apr 29 17:39:25 devstack sudo[112757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:25 devstack sudo[112755]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af" returned: 0 in 0.845s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:25 devstack cinder-volume[84547]: DEBUG cinder.utils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Path /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1b2be103-3369-46ec-8ed6-8bb8b58bf554 not found in is_blk_device check {{(pid=84547) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 17:39:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1b2be103-3369-46ec-8ed6-8bb8b58bf554 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:25 devstack sudo[112765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1b2be103-3369-46ec-8ed6-8bb8b58bf554 Apr 29 17:39:25 devstack sudo[112765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:25 devstack sudo[112757]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d43f890f-ae94-47bf-bfe5-d40caa142b8f tempest-SnapshotDependencyTests-786502227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914" returned: 0 in 0.852s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d43f890f-ae94-47bf-bfe5-d40caa142b8f tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:25 devstack sudo[112768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914 Apr 29 17:39:25 devstack sudo[112768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:26 devstack sudo[112768]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d43f890f-ae94-47bf-bfe5-d40caa142b8f tempest-SnapshotDependencyTests-786502227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3c6a61bb-3195-4093-9642-994eb0e66914" returned: 0 in 0.628s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d43f890f-ae94-47bf-bfe5-d40caa142b8f tempest-SnapshotDependencyTests-786502227 None] Lock "cinder-quobyte-3c6a61bb-3195-4093-9642-994eb0e66914" released by "delete_volume" :: held 1.553s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:26 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-d43f890f-ae94-47bf-bfe5-d40caa142b8f tempest-SnapshotDependencyTests-786502227 None] Created reservations ['f2bd9d2d-f3ec-4f5c-af45-916ebbb9388c', '5374c68a-6692-4cc7-a843-095729619b99', '725640ed-17e0-4f3c-9d76-0241f5a95079', '032c1192-38ce-44df-a17f-7f125cf498e3'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:39:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d43f890f-ae94-47bf-bfe5-d40caa142b8f tempest-SnapshotDependencyTests-786502227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d43f890f-ae94-47bf-bfe5-d40caa142b8f tempest-SnapshotDependencyTests-786502227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d43f890f-ae94-47bf-bfe5-d40caa142b8f tempest-SnapshotDependencyTests-786502227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:26 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d43f890f-ae94-47bf-bfe5-d40caa142b8f tempest-SnapshotDependencyTests-786502227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d43f890f-ae94-47bf-bfe5-d40caa142b8f tempest-SnapshotDependencyTests-786502227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d43f890f-ae94-47bf-bfe5-d40caa142b8f tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:26 devstack sudo[112781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:39:26 devstack sudo[112781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a9c72633-1a96-4a65-a8c1-49ad0e0d6534 tempest-SnapshotDependencyTests-786502227 None] Acquiring lock "cinder-3af48036-5ac9-4af0-bae1-ecb7c24f1238-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a9c72633-1a96-4a65-a8c1-49ad0e0d6534 tempest-SnapshotDependencyTests-786502227 None] Lock "cinder-3af48036-5ac9-4af0-bae1-ecb7c24f1238-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a9c72633-1a96-4a65-a8c1-49ad0e0d6534 tempest-SnapshotDependencyTests-786502227 None] Acquiring lock "cinder-quobyte-3af48036-5ac9-4af0-bae1-ecb7c24f1238" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a9c72633-1a96-4a65-a8c1-49ad0e0d6534 tempest-SnapshotDependencyTests-786502227 None] Lock "cinder-quobyte-3af48036-5ac9-4af0-bae1-ecb7c24f1238" acquired by "delete_volume" :: waited 0.037s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:27 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0f2682-8ab9-485c-89ee-dd1f2d4252ed]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a9c72633-1a96-4a65-a8c1-49ad0e0d6534 tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3af48036-5ac9-4af0-bae1-ecb7c24f1238 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:27 devstack sudo[112784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3af48036-5ac9-4af0-bae1-ecb7c24f1238 Apr 29 17:39:27 devstack sudo[112784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:28 devstack sudo[112781]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d43f890f-ae94-47bf-bfe5-d40caa142b8f tempest-SnapshotDependencyTests-786502227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.536s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:28 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-d43f890f-ae94-47bf-bfe5-d40caa142b8f tempest-SnapshotDependencyTests-786502227 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:39:28 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d43f890f-ae94-47bf-bfe5-d40caa142b8f tempest-SnapshotDependencyTests-786502227 None] Deleted volume successfully. Apr 29 17:39:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d43f890f-ae94-47bf-bfe5-d40caa142b8f tempest-SnapshotDependencyTests-786502227 None] Lock "cinder-3c6a61bb-3195-4093-9642-994eb0e66914-delete_volume" released by "delete_volume" :: held 3.434s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:29 devstack sudo[112784]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a9c72633-1a96-4a65-a8c1-49ad0e0d6534 tempest-SnapshotDependencyTests-786502227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3af48036-5ac9-4af0-bae1-ecb7c24f1238" returned: 0 in 1.694s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:29 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a9c72633-1a96-4a65-a8c1-49ad0e0d6534 tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3af48036-5ac9-4af0-bae1-ecb7c24f1238 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:29 devstack sudo[112790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3af48036-5ac9-4af0-bae1-ecb7c24f1238 Apr 29 17:39:29 devstack sudo[112790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:30 devstack sudo[112790]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a9c72633-1a96-4a65-a8c1-49ad0e0d6534 tempest-SnapshotDependencyTests-786502227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-3af48036-5ac9-4af0-bae1-ecb7c24f1238" returned: 0 in 1.115s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:30 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a9c72633-1a96-4a65-a8c1-49ad0e0d6534 tempest-SnapshotDependencyTests-786502227 None] Lock "cinder-quobyte-3af48036-5ac9-4af0-bae1-ecb7c24f1238" released by "delete_volume" :: held 2.894s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:30 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-a9c72633-1a96-4a65-a8c1-49ad0e0d6534 tempest-SnapshotDependencyTests-786502227 None] Created reservations ['6edaed1d-56a3-4e30-a20a-bc96d289e862', '6308bddc-bf01-402e-b08f-a59320ea8241', '9fd69ed3-3061-4a2c-8e4d-91757eacfcb6', '5082529e-900a-474d-bbbe-f55e57496393'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:39:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a9c72633-1a96-4a65-a8c1-49ad0e0d6534 tempest-SnapshotDependencyTests-786502227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a9c72633-1a96-4a65-a8c1-49ad0e0d6534 tempest-SnapshotDependencyTests-786502227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a9c72633-1a96-4a65-a8c1-49ad0e0d6534 tempest-SnapshotDependencyTests-786502227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:30 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-a9c72633-1a96-4a65-a8c1-49ad0e0d6534 tempest-SnapshotDependencyTests-786502227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-a9c72633-1a96-4a65-a8c1-49ad0e0d6534 tempest-SnapshotDependencyTests-786502227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:30 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a9c72633-1a96-4a65-a8c1-49ad0e0d6534 tempest-SnapshotDependencyTests-786502227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:30 devstack sudo[112793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:39:30 devstack sudo[112793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:32 devstack sudo[112793]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-a9c72633-1a96-4a65-a8c1-49ad0e0d6534 tempest-SnapshotDependencyTests-786502227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.399s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:32 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-a9c72633-1a96-4a65-a8c1-49ad0e0d6534 tempest-SnapshotDependencyTests-786502227 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:39:32 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-a9c72633-1a96-4a65-a8c1-49ad0e0d6534 tempest-SnapshotDependencyTests-786502227 None] Deleted volume successfully. Apr 29 17:39:32 devstack sudo[112765]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:32 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-a9c72633-1a96-4a65-a8c1-49ad0e0d6534 tempest-SnapshotDependencyTests-786502227 None] Lock "cinder-3af48036-5ac9-4af0-bae1-ecb7c24f1238-delete_volume" released by "delete_volume" :: held 4.799s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1b2be103-3369-46ec-8ed6-8bb8b58bf554" returned: 0 in 6.374s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:32 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[a413fe8d-c2db-478d-b683-b91eea8d663a]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:32 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:32 devstack sudo[112796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af Apr 29 17:39:32 devstack sudo[112796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:33 devstack sudo[112796]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af" returned: 0 in 0.994s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Image conversion details: src /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1b2be103-3369-46ec-8ed6-8bb8b58bf554 {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:39:33 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Converted 1024.00 MB image at 160.62 MB/s Apr 29 17:39:33 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1b2be103-3369-46ec-8ed6-8bb8b58bf554 is being set with open permissions: ugo+rw Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1b2be103-3369-46ec-8ed6-8bb8b58bf554 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:33 devstack sudo[112801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1b2be103-3369-46ec-8ed6-8bb8b58bf554 Apr 29 17:39:33 devstack sudo[112801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Flow 'volume_create_manager' (a26bdc78-9265-4333-883b-7be52b807867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6f928f-565a-4c0b-aa86-2dbaa0c74cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6f928f-565a-4c0b-aa86-2dbaa0c74cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47537593-095f-49d3-aba0-a1a251d6a83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a428425d30f4107bd6820f4a0d19d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:39:33Z,use_quota=True,user_id='b3980e515dbc4840b2200c265e1afc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (befc5771-fccc-46db-9bed-306c2e5a22dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (befc5771-fccc-46db-9bed-306c2e5a22dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ad5d73-0c77-4b77-bc0e-84bcfc1f7977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG cinder.image.glance [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Creating Keystone auth plugin from conf {{(pid=84547) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ad5d73-0c77-4b77-bc0e-84bcfc1f7977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '47537593-095f-49d3-aba0-a1a251d6a83c', 'volume_name': 'volume-47537593-095f-49d3-aba0-a1a251d6a83c', 'volume_size': 1, 'image_id': '1af6ff74-bff5-40f0-997b-78213a492ffa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1af6ff74-bff5-40f0-997b-78213a492ffa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '84f7320d2a9baf5db51e2589d89a7256', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2a428425d30f4107bd6820f4a0d19d9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2df9d0957970744015c1b0dd3c44866abb491402b0678e7b9f3c05ba30e0561e6f58165527127da78706b3adec5ddbb3c0fd5fe72a2ad4ad201e70203379c84a', 'id': '1af6ff74-bff5-40f0-997b-78213a492ffa', 'created_at': datetime.datetime(2026, 4, 29, 15, 39, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 39, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1af6ff74-bff5-40f0-997b-78213a492ffa/file', 'properties': {}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b874b75e-12e0-4ffb-ba62-085b96a0260f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b874b75e-12e0-4ffb-ba62-085b96a0260f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafa208c-4aaa-48d6-ac5c-551d54a2ac8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:33 devstack sudo[112801]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:33 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Volume 47537593-095f-49d3-aba0-a1a251d6a83c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-47537593-095f-49d3-aba0-a1a251d6a83c', 'volume_size': 1, 'image_id': '1af6ff74-bff5-40f0-997b-78213a492ffa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1af6ff74-bff5-40f0-997b-78213a492ffa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '84f7320d2a9baf5db51e2589d89a7256', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2a428425d30f4107bd6820f4a0d19d9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2df9d0957970744015c1b0dd3c44866abb491402b0678e7b9f3c05ba30e0561e6f58165527127da78706b3adec5ddbb3c0fd5fe72a2ad4ad201e70203379c84a', 'id': '1af6ff74-bff5-40f0-997b-78213a492ffa', 'created_at': datetime.datetime(2026, 4, 29, 15, 39, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 39, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1af6ff74-bff5-40f0-997b-78213a492ffa/file', 'properties': {}}, 'image_service': } Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Trying to clone 47537593-095f-49d3-aba0-a1a251d6a83c from image 1af6ff74-bff5-40f0-997b-78213a492ffa at location (None, [{'url': 'file:///opt/stack/data/glance/images/1af6ff74-bff5-40f0-997b-78213a492ffa', 'metadata': {}}]). {{(pid=84547) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1b2be103-3369-46ec-8ed6-8bb8b58bf554" returned: 0 in 0.703s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-quobyte-1b2be103-3369-46ec-8ed6-8bb8b58bf554" released by "_copy_volume_from_snapshot" :: held 9.801s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "cinder-quobyte-2b0c8e07-806d-4f3e-8f70-e95968928f4c" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-quobyte-2b0c8e07-806d-4f3e-8f70-e95968928f4c" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Deleting offline snapshot 2b0c8e07-806d-4f3e-8f70-e95968928f4c of volume 2c91c9e3-85ce-41e9-b463-15a5dca790af {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] snapshot_file for this snap is: volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[779b7c1a-a022-4f49-b757-132c99f24796]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 17:39:33 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Image download 0.00 MB at 0.00 MB/s Apr 29 17:39:33 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5142080-14a7-41e1-86ba-8a86edb94abd]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:34 devstack sudo[112805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c Apr 29 17:39:34 devstack sudo[112805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:34 devstack sudo[112806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD Apr 29 17:39:34 devstack sudo[112806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:34 devstack sudo[112806]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD" returned: 0 in 0.696s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:34 devstack sudo[112805]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c" returned: 0 in 0.860s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:34 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c91c9e3-85ce-41e9-b463-15a5dca790af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:39:34 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6deb584-788c-457d-ba5f-3a80840639ac]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:34 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:34 devstack sudo[112815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD Apr 29 17:39:34 devstack sudo[112815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:34 devstack sudo[112816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af Apr 29 17:39:34 devstack sudo[112816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:35 devstack sudo[112815]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD" returned: 1 in 0.828s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:39:35 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Temporary image 1af6ff74-bff5-40f0-997b-78213a492ffa is fetched for user b3980e515dbc4840b2200c265e1afc54. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 17:39:35 devstack sudo[112816]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af" returned: 0 in 0.804s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:35 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f4ca3e-a330-4d0b-b583-7a085f52fe14]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:35 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:35 devstack sudo[112825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c Apr 29 17:39:35 devstack sudo[112825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:35 devstack sudo[112826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD Apr 29 17:39:35 devstack sudo[112826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:36 devstack sudo[112825]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c" returned: 0 in 0.751s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:36 devstack sudo[112826]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD" returned: 0 in 0.745s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:36 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:36 devstack sudo[112836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c Apr 29 17:39:36 devstack sudo[112836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:36 devstack sudo[112837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD Apr 29 17:39:36 devstack sudo[112837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:37 devstack sudo[112836]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af.2b0c8e07-806d-4f3e-8f70-e95968928f4c" returned: 0 in 0.661s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:37 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-quobyte-2b0c8e07-806d-4f3e-8f70-e95968928f4c" released by "_delete_snapshot" :: held 3.187s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.522s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8ed34441-19d9-423c-a869-e1a57e3b0da5 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 25.280s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:37 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-8ed34441-19d9-423c-a869-e1a57e3b0da5 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Creating offline snapshot 04fc64d2-4ab1-492d-aa30-397f29e1958b of volume 5984b101-9c7e-4183-8df5-4b36e4df75e4 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:39:37 devstack sudo[112837]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ed6587a-5bba-4f8f-8ed4-d45bfdfa2395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b2be103-3369-46ec-8ed6-8bb8b58bf554', 'volume_size': 1, 'source_volid': '2c91c9e3-85ce-41e9-b463-15a5dca790af', 'source_volstatus': 'available'}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b5e0a9-5ad7-43b2-af74-8f90a3ae5615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:37 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3d0d7c-138c-4887-bf46-92098d4378dd]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ed34441-19d9-423c-a869-e1a57e3b0da5 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD" returned: 1 in 0.792s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:39:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:37 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Volume volume-1b2be103-3369-46ec-8ed6-8bb8b58bf554 (1b2be103-3369-46ec-8ed6-8bb8b58bf554): created successfully Apr 29 17:39:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b5e0a9-5ad7-43b2-af74-8f90a3ae5615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:37 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Flow 'volume_create_manager' (bac634f9-dc2f-43c6-bbe7-6840814cfbe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:37 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d35e7636-67e0-4df8-9b81-48dd7bc27e7d tempest-VolumeDependencyTests-1128192403 None] Created volume successfully. Apr 29 17:39:37 devstack sudo[112845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4 Apr 29 17:39:37 devstack sudo[112845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:37 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d4c1baab-a95d-4c52-b288-7c32a6fabeec tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "cinder-2c91c9e3-85ce-41e9-b463-15a5dca790af-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:37 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d4c1baab-a95d-4c52-b288-7c32a6fabeec tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-2c91c9e3-85ce-41e9-b463-15a5dca790af-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:37 devstack sudo[112845]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ed34441-19d9-423c-a869-e1a57e3b0da5 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4" returned: 0 in 0.830s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:37 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ed34441-19d9-423c-a869-e1a57e3b0da5 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.04fc64d2-4ab1-492d-aa30-397f29e1958b 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:38 devstack sudo[112851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.04fc64d2-4ab1-492d-aa30-397f29e1958b 1G Apr 29 17:39:38 devstack sudo[112851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:38 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d4c1baab-a95d-4c52-b288-7c32a6fabeec tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "cinder-quobyte-2c91c9e3-85ce-41e9-b463-15a5dca790af" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:38 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d4c1baab-a95d-4c52-b288-7c32a6fabeec tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-quobyte-2c91c9e3-85ce-41e9-b463-15a5dca790af" acquired by "delete_volume" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:38 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[7141708a-0f71-4be3-a548-29a6f2c43b0e]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4c1baab-a95d-4c52-b288-7c32a6fabeec tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:38 devstack sudo[112853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af Apr 29 17:39:38 devstack sudo[112853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:38 devstack sudo[112851]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ed34441-19d9-423c-a869-e1a57e3b0da5 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.04fc64d2-4ab1-492d-aa30-397f29e1958b 1G" returned: 0 in 0.906s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ed34441-19d9-423c-a869-e1a57e3b0da5 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5984b101-9c7e-4183-8df5-4b36e4df75e4 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.04fc64d2-4ab1-492d-aa30-397f29e1958b {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:38 devstack sudo[112853]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4c1baab-a95d-4c52-b288-7c32a6fabeec tempest-VolumeDependencyTests-1128192403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af" returned: 0 in 0.815s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:38 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4c1baab-a95d-4c52-b288-7c32a6fabeec tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:38 devstack sudo[112862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5984b101-9c7e-4183-8df5-4b36e4df75e4 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.04fc64d2-4ab1-492d-aa30-397f29e1958b Apr 29 17:39:38 devstack sudo[112862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:38 devstack sudo[112863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af Apr 29 17:39:38 devstack sudo[112863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:39 devstack sudo[112863]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4c1baab-a95d-4c52-b288-7c32a6fabeec tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2c91c9e3-85ce-41e9-b463-15a5dca790af" returned: 0 in 0.707s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:39 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d4c1baab-a95d-4c52-b288-7c32a6fabeec tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-quobyte-2c91c9e3-85ce-41e9-b463-15a5dca790af" released by "delete_volume" :: held 1.612s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:39 devstack sudo[112862]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ed34441-19d9-423c-a869-e1a57e3b0da5 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5984b101-9c7e-4183-8df5-4b36e4df75e4 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.04fc64d2-4ab1-492d-aa30-397f29e1958b" returned: 0 in 0.808s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:39 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-8ed34441-19d9-423c-a869-e1a57e3b0da5 tempest-CreateVolumesFromSnapshotTest-1874363764 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.04fc64d2-4ab1-492d-aa30-397f29e1958b is being set with open permissions: ugo+rw Apr 29 17:39:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ed34441-19d9-423c-a869-e1a57e3b0da5 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.04fc64d2-4ab1-492d-aa30-397f29e1958b {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:39 devstack sudo[112870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.04fc64d2-4ab1-492d-aa30-397f29e1958b Apr 29 17:39:39 devstack sudo[112870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:39 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-d4c1baab-a95d-4c52-b288-7c32a6fabeec tempest-VolumeDependencyTests-1128192403 None] Created reservations ['7f27b275-a469-43a0-a0e8-69b8af8bf0e8', '87c5ea1b-a923-4ffa-8956-ec1a23b7e6be', '9c3d95f8-1667-4b00-aa4e-20af3d66f4df', 'a509577b-603c-41ff-b1cb-69412434e174'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:39:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d4c1baab-a95d-4c52-b288-7c32a6fabeec tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d4c1baab-a95d-4c52-b288-7c32a6fabeec tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d4c1baab-a95d-4c52-b288-7c32a6fabeec tempest-VolumeDependencyTests-1128192403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:39 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d4c1baab-a95d-4c52-b288-7c32a6fabeec tempest-VolumeDependencyTests-1128192403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d4c1baab-a95d-4c52-b288-7c32a6fabeec tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:39 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4c1baab-a95d-4c52-b288-7c32a6fabeec tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:39 devstack sudo[112872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:39:39 devstack sudo[112872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:40 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f395f5db-3e90-44f4-90cc-1a5939f71d45 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "cinder-1b2be103-3369-46ec-8ed6-8bb8b58bf554-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:40 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f395f5db-3e90-44f4-90cc-1a5939f71d45 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-1b2be103-3369-46ec-8ed6-8bb8b58bf554-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:40 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f395f5db-3e90-44f4-90cc-1a5939f71d45 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "cinder-quobyte-1b2be103-3369-46ec-8ed6-8bb8b58bf554" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:40 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f395f5db-3e90-44f4-90cc-1a5939f71d45 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-quobyte-1b2be103-3369-46ec-8ed6-8bb8b58bf554" acquired by "delete_volume" :: waited 0.023s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:40 devstack sudo[112870]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ed34441-19d9-423c-a869-e1a57e3b0da5 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.04fc64d2-4ab1-492d-aa30-397f29e1958b" returned: 0 in 0.733s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:40 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[0854505a-9a89-47ea-a0dc-d0fc3d928c7b]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f395f5db-3e90-44f4-90cc-1a5939f71d45 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1b2be103-3369-46ec-8ed6-8bb8b58bf554 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ed34441-19d9-423c-a869-e1a57e3b0da5 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:40 devstack sudo[112878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.info Apr 29 17:39:40 devstack sudo[112878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:40 devstack sudo[112872]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:40 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d4c1baab-a95d-4c52-b288-7c32a6fabeec tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.726s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:40 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-d4c1baab-a95d-4c52-b288-7c32a6fabeec tempest-VolumeDependencyTests-1128192403 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:39:40 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d4c1baab-a95d-4c52-b288-7c32a6fabeec tempest-VolumeDependencyTests-1128192403 None] Deleted volume successfully. Apr 29 17:39:40 devstack sudo[112877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1b2be103-3369-46ec-8ed6-8bb8b58bf554 Apr 29 17:39:40 devstack sudo[112877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:40 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d4c1baab-a95d-4c52-b288-7c32a6fabeec tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-2c91c9e3-85ce-41e9-b463-15a5dca790af-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:41 devstack sudo[112878]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ed34441-19d9-423c-a869-e1a57e3b0da5 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.info" returned: 0 in 0.744s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:41 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-8ed34441-19d9-423c-a869-e1a57e3b0da5 tempest-CreateVolumesFromSnapshotTest-1874363764 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.info is being set with open permissions: ugo+rw Apr 29 17:39:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ed34441-19d9-423c-a869-e1a57e3b0da5 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:41 devstack sudo[112877]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f395f5db-3e90-44f4-90cc-1a5939f71d45 tempest-VolumeDependencyTests-1128192403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1b2be103-3369-46ec-8ed6-8bb8b58bf554" returned: 0 in 0.797s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f395f5db-3e90-44f4-90cc-1a5939f71d45 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1b2be103-3369-46ec-8ed6-8bb8b58bf554 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:41 devstack sudo[112885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.info Apr 29 17:39:41 devstack sudo[112885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:41 devstack sudo[112886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1b2be103-3369-46ec-8ed6-8bb8b58bf554 Apr 29 17:39:41 devstack sudo[112886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:41 devstack sudo[112886]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f395f5db-3e90-44f4-90cc-1a5939f71d45 tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-1b2be103-3369-46ec-8ed6-8bb8b58bf554" returned: 0 in 0.678s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:41 devstack sudo[112885]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:41 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f395f5db-3e90-44f4-90cc-1a5939f71d45 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-quobyte-1b2be103-3369-46ec-8ed6-8bb8b58bf554" released by "delete_volume" :: held 1.540s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ed34441-19d9-423c-a869-e1a57e3b0da5 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.info" returned: 0 in 0.719s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8ed34441-19d9-423c-a869-e1a57e3b0da5 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.864s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.805s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:41 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47537593-095f-49d3-aba0-a1a251d6a83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a428425d30f4107bd6820f4a0d19d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:39:33Z,use_quota=True,user_id='b3980e515dbc4840b2200c265e1afc54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:39:41 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Creating volume 47537593-095f-49d3-aba0-a1a251d6a83c {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:39:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:41 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:41 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:41 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:39:41 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:39:41 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:42 devstack sudo[112891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c 1073741824 Apr 29 17:39:42 devstack sudo[112891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:42 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-8ed34441-19d9-423c-a869-e1a57e3b0da5 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Create snapshot completed successfully Apr 29 17:39:42 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-f395f5db-3e90-44f4-90cc-1a5939f71d45 tempest-VolumeDependencyTests-1128192403 None] Created reservations ['f991867d-8380-4eb4-b651-5364d56d7a16', '211570c3-8452-4169-994e-6acf536c0466', '8d72c1a6-ee71-4431-bc1f-1c8c486abacd', 'c0980503-9a24-4d44-9df7-c93650e69ae5'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:39:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f395f5db-3e90-44f4-90cc-1a5939f71d45 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f395f5db-3e90-44f4-90cc-1a5939f71d45 tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:42 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f395f5db-3e90-44f4-90cc-1a5939f71d45 tempest-VolumeDependencyTests-1128192403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:42 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f395f5db-3e90-44f4-90cc-1a5939f71d45 tempest-VolumeDependencyTests-1128192403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f395f5db-3e90-44f4-90cc-1a5939f71d45 tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f395f5db-3e90-44f4-90cc-1a5939f71d45 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:42 devstack sudo[112893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:39:42 devstack sudo[112893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dac1fbf8-7f33-4f2d-9e8c-0c60ed0f6979 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "cinder-234eef1f-eb66-4ed1-ad77-0e884721f0f5-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dac1fbf8-7f33-4f2d-9e8c-0c60ed0f6979 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-234eef1f-eb66-4ed1-ad77-0e884721f0f5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dac1fbf8-7f33-4f2d-9e8c-0c60ed0f6979 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "cinder-quobyte-234eef1f-eb66-4ed1-ad77-0e884721f0f5" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:42 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dac1fbf8-7f33-4f2d-9e8c-0c60ed0f6979 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-quobyte-234eef1f-eb66-4ed1-ad77-0e884721f0f5" acquired by "delete_volume" :: waited 0.047s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:42 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a83d63-dea4-43f8-b860-dcfa2b145a13]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:42 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dac1fbf8-7f33-4f2d-9e8c-0c60ed0f6979 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-234eef1f-eb66-4ed1-ad77-0e884721f0f5 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:42 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:39:42 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Flow 'volume_create_manager' (f4be6ca4-3bcf-4188-b464-5e0d5403c9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af1fabe-cfef-488a-8a6c-7975bb4f6282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af1fabe-cfef-488a-8a6c-7975bb4f6282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-565439200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20622c02-407d-4d79-bf46-84665e239665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d830a9fd054105a07e646594e3ee88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:39:43Z,use_quota=True,user_id='387c837bb49e44848af8f6f7e7bfcf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337eaeac-475a-4a83-9bb2-0b41d5d5433a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337eaeac-475a-4a83-9bb2-0b41d5d5433a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:43 devstack sudo[112899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-234eef1f-eb66-4ed1-ad77-0e884721f0f5 Apr 29 17:39:43 devstack sudo[112899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc75b9e-aed7-46bc-bed4-ba19df132d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cc75b9e-aed7-46bc-bed4-ba19df132d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20622c02-407d-4d79-bf46-84665e239665', 'volume_name': 'volume-20622c02-407d-4d79-bf46-84665e239665', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4bb585-3193-4290-873f-f9ec868f3f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4bb585-3193-4290-873f-f9ec868f3f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efe19dc-c6b8-4199-bb45-ff1e40c2f798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:43 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Volume 20622c02-407d-4d79-bf46-84665e239665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20622c02-407d-4d79-bf46-84665e239665', 'volume_size': 1} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:43 devstack sudo[112891]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c 1073741824" returned: 0 in 1.195s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:43 devstack sudo[112893]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f395f5db-3e90-44f4-90cc-1a5939f71d45 tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 1.031s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-f395f5db-3e90-44f4-90cc-1a5939f71d45 tempest-VolumeDependencyTests-1128192403 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:39:43 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f395f5db-3e90-44f4-90cc-1a5939f71d45 tempest-VolumeDependencyTests-1128192403 None] Deleted volume successfully. Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f395f5db-3e90-44f4-90cc-1a5939f71d45 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-1b2be103-3369-46ec-8ed6-8bb8b58bf554-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:43 devstack sudo[112901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c Apr 29 17:39:43 devstack sudo[112901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Flow 'volume_create_manager' (379365d5-c214-4185-91a8-8c04bad6f1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f5da5e-3c80-4f5d-a288-1f21b0d46c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f5da5e-3c80-4f5d-a288-1f21b0d46c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-769946179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc93f05-378e-452d-8699-b7ef11086e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d830a9fd054105a07e646594e3ee88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:39:43Z,use_quota=True,user_id='387c837bb49e44848af8f6f7e7bfcf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b464f39-e77b-40e4-be1e-fd58b358e5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b464f39-e77b-40e4-be1e-fd58b358e5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d0453c-d7e3-410a-860e-facf50a6a12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d0453c-d7e3-410a-860e-facf50a6a12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cc93f05-378e-452d-8699-b7ef11086e88', 'volume_name': 'volume-2cc93f05-378e-452d-8699-b7ef11086e88', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511a477b-4fbb-477b-a751-303e2d1f762f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511a477b-4fbb-477b-a751-303e2d1f762f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d384c6c0-c888-4dde-8d65-1044b82e72fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:43 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Volume 2cc93f05-378e-452d-8699-b7ef11086e88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cc93f05-378e-452d-8699-b7ef11086e88', 'volume_size': 1} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Flow 'volume_create_manager' (1377e70d-b548-42a5-b0c5-228b8049d4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c3d172-653c-49b5-96d7-810b45a77397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:43 devstack sudo[112899]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dac1fbf8-7f33-4f2d-9e8c-0c60ed0f6979 tempest-VolumeDependencyTests-1128192403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-234eef1f-eb66-4ed1-ad77-0e884721f0f5" returned: 0 in 1.032s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dac1fbf8-7f33-4f2d-9e8c-0c60ed0f6979 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-234eef1f-eb66-4ed1-ad77-0e884721f0f5 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08c3d172-653c-49b5-96d7-810b45a77397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-807502101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec24336d-5f3e-4004-bc28-46135b3780ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d830a9fd054105a07e646594e3ee88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:39:44Z,use_quota=True,user_id='387c837bb49e44848af8f6f7e7bfcf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490785e4-e47a-44d7-85fe-3998e7b167a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490785e4-e47a-44d7-85fe-3998e7b167a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8114a82-20e7-441b-bf56-885fab0e4cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:43 devstack sudo[112908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-234eef1f-eb66-4ed1-ad77-0e884721f0f5 Apr 29 17:39:43 devstack sudo[112908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8114a82-20e7-441b-bf56-885fab0e4cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec24336d-5f3e-4004-bc28-46135b3780ff', 'volume_name': 'volume-ec24336d-5f3e-4004-bc28-46135b3780ff', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b39af2b-166c-4f1b-b253-963fe18c09d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b39af2b-166c-4f1b-b253-963fe18c09d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ff49fd-33b1-43c1-b2c2-18fce1a064ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:43 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Volume ec24336d-5f3e-4004-bc28-46135b3780ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec24336d-5f3e-4004-bc28-46135b3780ff', 'volume_size': 1} Apr 29 17:39:43 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:44 devstack sudo[112901]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c" returned: 0 in 0.751s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] <== create_volume: return (2021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.024s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.856s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-565439200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20622c02-407d-4d79-bf46-84665e239665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d830a9fd054105a07e646594e3ee88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:39:43Z,use_quota=True,user_id='387c837bb49e44848af8f6f7e7bfcf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Creating volume 20622c02-407d-4d79-bf46-84665e239665 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:39:44 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-20622c02-407d-4d79-bf46-84665e239665 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:44 devstack sudo[112910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-20622c02-407d-4d79-bf46-84665e239665 1073741824 Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Attempting download of 1af6ff74-bff5-40f0-997b-78213a492ffa ((None, [{'url': 'file:///opt/stack/data/glance/images/1af6ff74-bff5-40f0-997b-78213a492ffa', 'metadata': {}}])) to volume 47537593-095f-49d3-aba0-a1a251d6a83c. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 17:39:44 devstack sudo[112910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33abc19-70fd-4f65-8e3c-7113fa375a80]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1af6ff74-bff5-40f0-997b-78213a492ffa_1tfvg8ci {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Flow 'volume_create_manager' (74f3f2e8-8e84-4ab4-b48c-f4387ef02bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a876a5-8a9d-48c0-82e6-daa6c0280500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a876a5-8a9d-48c0-82e6-daa6c0280500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1360258223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7068eed-595b-4a80-91cf-ea7e7bb97347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d830a9fd054105a07e646594e3ee88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:39:44Z,use_quota=True,user_id='387c837bb49e44848af8f6f7e7bfcf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e3c607-57f7-433e-b0f6-cdc1dcb5c959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e3c607-57f7-433e-b0f6-cdc1dcb5c959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d5cff0-b9f2-4f94-a176-f2738d3a9832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d5cff0-b9f2-4f94-a176-f2738d3a9832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7068eed-595b-4a80-91cf-ea7e7bb97347', 'volume_name': 'volume-e7068eed-595b-4a80-91cf-ea7e7bb97347', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ce0b61-bab9-457a-a341-49caa88eaac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ce0b61-bab9-457a-a341-49caa88eaac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebbddf08-9801-405b-a590-7116f619ff4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:44 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Volume e7068eed-595b-4a80-91cf-ea7e7bb97347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7068eed-595b-4a80-91cf-ea7e7bb97347', 'volume_size': 1} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:44 devstack sudo[112912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1af6ff74-bff5-40f0-997b-78213a492ffa_1tfvg8ci Apr 29 17:39:44 devstack sudo[112912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Flow 'volume_create_manager' (95e2b9c0-4542-409f-bb5f-6368a77e5c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d0e5ce-f895-46d3-8368-baef0c805317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2d0e5ce-f895-46d3-8368-baef0c805317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1506270776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d470931f-071a-42c7-9ffe-2539457f9e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d830a9fd054105a07e646594e3ee88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:39:45Z,use_quota=True,user_id='387c837bb49e44848af8f6f7e7bfcf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:44 devstack sudo[112908]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775b4509-911b-4f02-bd3d-a2b23e22463e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775b4509-911b-4f02-bd3d-a2b23e22463e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a3cfd6-22dd-4fe7-8476-212154648a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a3cfd6-22dd-4fe7-8476-212154648a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd470931f-071a-42c7-9ffe-2539457f9e88', 'volume_name': 'volume-d470931f-071a-42c7-9ffe-2539457f9e88', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442b195e-79df-42b1-8e82-3cc5ed182289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (442b195e-79df-42b1-8e82-3cc5ed182289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51092930-8596-4163-9e04-0ff4f74ef581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:44 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Volume d470931f-071a-42c7-9ffe-2539457f9e88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d470931f-071a-42c7-9ffe-2539457f9e88', 'volume_size': 1} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dac1fbf8-7f33-4f2d-9e8c-0c60ed0f6979 tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-234eef1f-eb66-4ed1-ad77-0e884721f0f5" returned: 0 in 0.879s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dac1fbf8-7f33-4f2d-9e8c-0c60ed0f6979 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-quobyte-234eef1f-eb66-4ed1-ad77-0e884721f0f5" released by "delete_volume" :: held 1.992s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-dac1fbf8-7f33-4f2d-9e8c-0c60ed0f6979 tempest-VolumeDependencyTests-1128192403 None] Created reservations ['4df247be-5dfe-48da-817e-4e7fb18777ac', '5d51de21-9170-41a7-93fb-7f48657caac3', '1492d3ef-db5c-4ccb-a750-c0e0e83c909a', '8a6e5382-c66e-438d-b2a5-ee972bfcd52a'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-dac1fbf8-7f33-4f2d-9e8c-0c60ed0f6979 tempest-VolumeDependencyTests-1128192403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-dac1fbf8-7f33-4f2d-9e8c-0c60ed0f6979 tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:44 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-dac1fbf8-7f33-4f2d-9e8c-0c60ed0f6979 tempest-VolumeDependencyTests-1128192403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:44 devstack sudo[112910]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-dac1fbf8-7f33-4f2d-9e8c-0c60ed0f6979 tempest-VolumeDependencyTests-1128192403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-dac1fbf8-7f33-4f2d-9e8c-0c60ed0f6979 tempest-VolumeDependencyTests-1128192403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dac1fbf8-7f33-4f2d-9e8c-0c60ed0f6979 tempest-VolumeDependencyTests-1128192403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-20622c02-407d-4d79-bf46-84665e239665 1073741824" returned: 0 in 0.990s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:45 devstack sudo[112919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:39:45 devstack sudo[112919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-20622c02-407d-4d79-bf46-84665e239665 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:45 devstack sudo[112923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-20622c02-407d-4d79-bf46-84665e239665 Apr 29 17:39:45 devstack sudo[112923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:45 devstack sudo[112912]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1af6ff74-bff5-40f0-997b-78213a492ffa_1tfvg8ci" returned: 0 in 1.011s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1af6ff74-bff5-40f0-997b-78213a492ffa_1tfvg8ci {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:45 devstack sudo[112925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1af6ff74-bff5-40f0-997b-78213a492ffa_1tfvg8ci Apr 29 17:39:45 devstack sudo[112925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:45 devstack sudo[112919]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-dac1fbf8-7f33-4f2d-9e8c-0c60ed0f6979 tempest-VolumeDependencyTests-1128192403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.783s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-dac1fbf8-7f33-4f2d-9e8c-0c60ed0f6979 tempest-VolumeDependencyTests-1128192403 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:39:45 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-dac1fbf8-7f33-4f2d-9e8c-0c60ed0f6979 tempest-VolumeDependencyTests-1128192403 None] Deleted volume successfully. Apr 29 17:39:45 devstack sudo[112923]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-dac1fbf8-7f33-4f2d-9e8c-0c60ed0f6979 tempest-VolumeDependencyTests-1128192403 None] Lock "cinder-234eef1f-eb66-4ed1-ad77-0e884721f0f5-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-20622c02-407d-4d79-bf46-84665e239665" returned: 0 in 0.752s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.416s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-769946179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cc93f05-378e-452d-8699-b7ef11086e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d830a9fd054105a07e646594e3ee88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:39:43Z,use_quota=True,user_id='387c837bb49e44848af8f6f7e7bfcf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Creating volume 2cc93f05-378e-452d-8699-b7ef11086e88 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:39:45 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2cc93f05-378e-452d-8699-b7ef11086e88 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:45 devstack sudo[112929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2cc93f05-378e-452d-8699-b7ef11086e88 1073741824 Apr 29 17:39:45 devstack sudo[112929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efe19dc-c6b8-4199-bb45-ff1e40c2f798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20622c02-407d-4d79-bf46-84665e239665', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c063e2a-0586-4bb0-9acb-6bf54c325dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:45 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Volume volume-20622c02-407d-4d79-bf46-84665e239665 (20622c02-407d-4d79-bf46-84665e239665): created successfully Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c063e2a-0586-4bb0-9acb-6bf54c325dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:45 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Flow 'volume_create_manager' (f4be6ca4-3bcf-4188-b464-5e0d5403c9ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:45 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-795e84f8-b2ca-4a9d-9f8a-0921c540bfef tempest-CreateVolumesFromSnapshotTest-1874363764 None] Created volume successfully. Apr 29 17:39:45 devstack sudo[112925]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1af6ff74-bff5-40f0-997b-78213a492ffa_1tfvg8ci" returned: 1 in 0.790s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1af6ff74-bff5-40f0-997b-78213a492ffa_1tfvg8ci' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:39:46 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad94b49d-9272-4f5c-9ec9-2b4075f051f7]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:46 devstack sudo[112933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD Apr 29 17:39:46 devstack sudo[112933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:46 devstack sudo[112929]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2cc93f05-378e-452d-8699-b7ef11086e88 1073741824" returned: 0 in 0.929s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:46 devstack sudo[112933]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD" returned: 0 in 0.856s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:46 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2cc93f05-378e-452d-8699-b7ef11086e88 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:46 devstack sudo[112942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2cc93f05-378e-452d-8699-b7ef11086e88 Apr 29 17:39:46 devstack sudo[112942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:46 devstack sudo[112941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD Apr 29 17:39:46 devstack sudo[112941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:47 devstack sudo[112942]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2cc93f05-378e-452d-8699-b7ef11086e88" returned: 0 in 0.610s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.512s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-807502101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec24336d-5f3e-4004-bc28-46135b3780ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d830a9fd054105a07e646594e3ee88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:39:44Z,use_quota=True,user_id='387c837bb49e44848af8f6f7e7bfcf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Creating volume ec24336d-5f3e-4004-bc28-46135b3780ff {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:39:47 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ec24336d-5f3e-4004-bc28-46135b3780ff 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:47 devstack sudo[112950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ec24336d-5f3e-4004-bc28-46135b3780ff 1073741824 Apr 29 17:39:47 devstack sudo[112950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:47 devstack sudo[112941]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d384c6c0-c888-4dde-8d65-1044b82e72fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cc93f05-378e-452d-8699-b7ef11086e88', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1801d7af-ece1-4175-8fc1-1a377054c8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD" returned: 1 in 0.727s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] 1af6ff74-bff5-40f0-997b-78213a492ffa was raw, converting to raw {{(pid=84547) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:47 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Volume volume-2cc93f05-378e-452d-8699-b7ef11086e88 (2cc93f05-378e-452d-8699-b7ef11086e88): created successfully Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1801d7af-ece1-4175-8fc1-1a377054c8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:47 devstack sudo[112952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c Apr 29 17:39:47 devstack sudo[112952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:47 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Flow 'volume_create_manager' (379365d5-c214-4185-91a8-8c04bad6f1d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:47 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-e3b10c4d-ab22-4b9b-9943-dc9dfad85e44 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Created volume successfully. Apr 29 17:39:48 devstack sudo[112950]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ec24336d-5f3e-4004-bc28-46135b3780ff 1073741824" returned: 0 in 0.780s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:48 devstack sudo[112952]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c" returned: 0 in 0.722s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1af6ff74-bff5-40f0-997b-78213a492ffa_fxbw72fqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c {{(pid=84547) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 17:39:48 devstack cinder-volume[84547]: INFO cinder.image.image_utils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Converted 0.00 MB image at 0.00 MB/s Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ec24336d-5f3e-4004-bc28-46135b3780ff {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:48 devstack sudo[112962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c 1G Apr 29 17:39:48 devstack sudo[112962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:48 devstack sudo[112964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ec24336d-5f3e-4004-bc28-46135b3780ff Apr 29 17:39:48 devstack sudo[112964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:48 devstack sudo[112964]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ec24336d-5f3e-4004-bc28-46135b3780ff" returned: 0 in 0.591s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.602s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1360258223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7068eed-595b-4a80-91cf-ea7e7bb97347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d830a9fd054105a07e646594e3ee88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:39:44Z,use_quota=True,user_id='387c837bb49e44848af8f6f7e7bfcf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Creating volume e7068eed-595b-4a80-91cf-ea7e7bb97347 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:39:48 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e7068eed-595b-4a80-91cf-ea7e7bb97347 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:48 devstack sudo[112962]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c 1G" returned: 0 in 0.649s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ff49fd-33b1-43c1-b2c2-18fce1a064ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec24336d-5f3e-4004-bc28-46135b3780ff', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:48 devstack sudo[112970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e7068eed-595b-4a80-91cf-ea7e7bb97347 1073741824 Apr 29 17:39:48 devstack sudo[112970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:48 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454dee13-7583-4092-8257-c287ffa4a2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:49 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Volume volume-ec24336d-5f3e-4004-bc28-46135b3780ff (ec24336d-5f3e-4004-bc28-46135b3780ff): created successfully Apr 29 17:39:49 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454dee13-7583-4092-8257-c287ffa4a2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:49 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Flow 'volume_create_manager' (1377e70d-b548-42a5-b0c5-228b8049d4e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:49 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf50bcc3-3a0a-4b1e-8a1f-dfe1f622738c]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:49 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f83c49ed-a2cc-4124-9462-0f370b00ea45 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Created volume successfully. Apr 29 17:39:49 devstack sudo[112972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c Apr 29 17:39:49 devstack sudo[112972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:49 devstack sudo[112972]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c" returned: 0 in 0.733s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:49 devstack sudo[112970]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e7068eed-595b-4a80-91cf-ea7e7bb97347 1073741824" returned: 0 in 0.857s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:49 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e7068eed-595b-4a80-91cf-ea7e7bb97347 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:49 devstack sudo[112979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c Apr 29 17:39:49 devstack sudo[112979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:49 devstack sudo[112980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e7068eed-595b-4a80-91cf-ea7e7bb97347 Apr 29 17:39:49 devstack sudo[112980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:50 devstack sudo[112980]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e7068eed-595b-4a80-91cf-ea7e7bb97347" returned: 0 in 0.630s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.680s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1506270776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d470931f-071a-42c7-9ffe-2539457f9e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82d830a9fd054105a07e646594e3ee88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:39:45Z,use_quota=True,user_id='387c837bb49e44848af8f6f7e7bfcf4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Creating volume d470931f-071a-42c7-9ffe-2539457f9e88 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:50 devstack sudo[112979]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:39:50 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d470931f-071a-42c7-9ffe-2539457f9e88 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c" returned: 1 in 0.751s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Downloaded image 1af6ff74-bff5-40f0-997b-78213a492ffa ((None, [{'url': 'file:///opt/stack/data/glance/images/1af6ff74-bff5-40f0-997b-78213a492ffa', 'metadata': {}}])) to volume 47537593-095f-49d3-aba0-a1a251d6a83c successfully. {{(pid=84547) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG cinder.image.image_utils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Temporary image 1af6ff74-bff5-40f0-997b-78213a492ffa for user b3980e515dbc4840b2200c265e1afc54 is deleted. {{(pid=84547) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG cinder.volume.volume_utils [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Marking volume 47537593-095f-49d3-aba0-a1a251d6a83c as bootable. {{(pid=84547) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 17:39:50 devstack sudo[112987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d470931f-071a-42c7-9ffe-2539457f9e88 1073741824 Apr 29 17:39:50 devstack sudo[112987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebbddf08-9801-405b-a590-7116f619ff4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7068eed-595b-4a80-91cf-ea7e7bb97347', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d10a577-20f3-470a-ac95-2b8456f6fc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Copying metadata from image 1af6ff74-bff5-40f0-997b-78213a492ffa to 47537593-095f-49d3-aba0-a1a251d6a83c. {{(pid=84547) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Creating volume glance metadata for volume 47537593-095f-49d3-aba0-a1a251d6a83c backed by image 1af6ff74-bff5-40f0-997b-78213a492ffa with: {'image_id': '1af6ff74-bff5-40f0-997b-78213a492ffa', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '84f7320d2a9baf5db51e2589d89a7256', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84547) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 17:39:50 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Volume volume-e7068eed-595b-4a80-91cf-ea7e7bb97347 (e7068eed-595b-4a80-91cf-ea7e7bb97347): created successfully Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d10a577-20f3-470a-ac95-2b8456f6fc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Flow 'volume_create_manager' (74f3f2e8-8e84-4ab4-b48c-f4387ef02bcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:50 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-1f4b2471-5a7f-4eba-b6e9-5a30579e1c46 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Created volume successfully. Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafa208c-4aaa-48d6-ac5c-551d54a2ac8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47537593-095f-49d3-aba0-a1a251d6a83c', 'volume_size': 1, 'image_id': '1af6ff74-bff5-40f0-997b-78213a492ffa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1af6ff74-bff5-40f0-997b-78213a492ffa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '84f7320d2a9baf5db51e2589d89a7256', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2a428425d30f4107bd6820f4a0d19d9b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2df9d0957970744015c1b0dd3c44866abb491402b0678e7b9f3c05ba30e0561e6f58165527127da78706b3adec5ddbb3c0fd5fe72a2ad4ad201e70203379c84a', 'id': '1af6ff74-bff5-40f0-997b-78213a492ffa', 'created_at': datetime.datetime(2026, 4, 29, 15, 39, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 15, 39, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1af6ff74-bff5-40f0-997b-78213a492ffa/file', 'properties': {}}, 'image_service': }' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef63484-2e17-4b83-9b8a-537ca7db7524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:50 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Volume volume-47537593-095f-49d3-aba0-a1a251d6a83c (47537593-095f-49d3-aba0-a1a251d6a83c): created successfully Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef63484-2e17-4b83-9b8a-537ca7db7524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:50 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Flow 'volume_create_manager' (a26bdc78-9265-4333-883b-7be52b807867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:50 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-8062b27e-49e9-4d15-9575-13eef03f3b96 tempest-VolumeImageDependencyTests-1462280589 None] Created volume successfully. Apr 29 17:39:51 devstack sudo[112987]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d470931f-071a-42c7-9ffe-2539457f9e88 1073741824" returned: 0 in 0.815s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d470931f-071a-42c7-9ffe-2539457f9e88 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:51 devstack sudo[112993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d470931f-071a-42c7-9ffe-2539457f9e88 Apr 29 17:39:51 devstack sudo[112993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] Acquiring lock "cinder-47537593-095f-49d3-aba0-a1a251d6a83c-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] Lock "cinder-47537593-095f-49d3-aba0-a1a251d6a83c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] Acquiring lock "cinder-quobyte-47537593-095f-49d3-aba0-a1a251d6a83c" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:51 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] Lock "cinder-quobyte-47537593-095f-49d3-aba0-a1a251d6a83c" acquired by "delete_volume" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:51 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc8dbe9-4c4d-41b2-bce8-b952651f038d]: (4, 'raw') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:51 devstack sudo[112993]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d470931f-071a-42c7-9ffe-2539457f9e88" returned: 0 in 0.638s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:51 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:39:51 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51092930-8596-4163-9e04-0ff4f74ef581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d470931f-071a-42c7-9ffe-2539457f9e88', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:51 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f4696fa-b19f-46a9-a0e4-1e7134389b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:39:52 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Volume volume-d470931f-071a-42c7-9ffe-2539457f9e88 (d470931f-071a-42c7-9ffe-2539457f9e88): created successfully Apr 29 17:39:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f4696fa-b19f-46a9-a0e4-1e7134389b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:39:52 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Flow 'volume_create_manager' (95e2b9c0-4542-409f-bb5f-6368a77e5c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:39:52 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-112786b4-dbdf-4a92-bb86-5b5a2055f28b tempest-CreateVolumesFromSnapshotTest-1874363764 None] Created volume successfully. Apr 29 17:39:52 devstack sudo[112996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c Apr 29 17:39:52 devstack sudo[112996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f20746e8-1e4f-4d2e-92d2-a0587f1fc316 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "cinder-d470931f-071a-42c7-9ffe-2539457f9e88-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f20746e8-1e4f-4d2e-92d2-a0587f1fc316 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-d470931f-071a-42c7-9ffe-2539457f9e88-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f20746e8-1e4f-4d2e-92d2-a0587f1fc316 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "cinder-quobyte-d470931f-071a-42c7-9ffe-2539457f9e88" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:52 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f20746e8-1e4f-4d2e-92d2-a0587f1fc316 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-quobyte-d470931f-071a-42c7-9ffe-2539457f9e88" acquired by "delete_volume" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:52 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff7f209-149e-4f58-a817-7c60acf21e50]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f20746e8-1e4f-4d2e-92d2-a0587f1fc316 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d470931f-071a-42c7-9ffe-2539457f9e88 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:52 devstack sudo[112998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d470931f-071a-42c7-9ffe-2539457f9e88 Apr 29 17:39:52 devstack sudo[112998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:52 devstack sudo[112996]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c" returned: 0 in 0.742s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:52 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:52 devstack sudo[113002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c Apr 29 17:39:52 devstack sudo[113002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:53 devstack sudo[112998]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f20746e8-1e4f-4d2e-92d2-a0587f1fc316 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d470931f-071a-42c7-9ffe-2539457f9e88" returned: 0 in 0.776s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f20746e8-1e4f-4d2e-92d2-a0587f1fc316 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d470931f-071a-42c7-9ffe-2539457f9e88 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:53 devstack sudo[113009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d470931f-071a-42c7-9ffe-2539457f9e88 Apr 29 17:39:53 devstack sudo[113009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:53 devstack sudo[113002]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c" returned: 1 in 0.715s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c' failed. Not Retrying. {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 17:39:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:53 devstack sudo[113012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c Apr 29 17:39:53 devstack sudo[113012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:53 devstack sudo[113009]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:53 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f20746e8-1e4f-4d2e-92d2-a0587f1fc316 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-d470931f-071a-42c7-9ffe-2539457f9e88" returned: 0 in 0.642s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:53 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f20746e8-1e4f-4d2e-92d2-a0587f1fc316 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-quobyte-d470931f-071a-42c7-9ffe-2539457f9e88" released by "delete_volume" :: held 1.466s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-f20746e8-1e4f-4d2e-92d2-a0587f1fc316 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Created reservations ['ef408d41-de51-402d-b313-75017ae375a1', 'c6dcf86c-96f9-4d95-a379-89f60fd020ae', '02263d78-35e9-4533-b332-25f89fdc9ccf', 'a931e589-cff0-480e-b2a9-ee1751c0e607'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:39:54 devstack sudo[113012]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-47537593-095f-49d3-aba0-a1a251d6a83c" returned: 0 in 0.622s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] Lock "cinder-quobyte-47537593-095f-49d3-aba0-a1a251d6a83c" released by "delete_volume" :: held 2.165s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f20746e8-1e4f-4d2e-92d2-a0587f1fc316 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f20746e8-1e4f-4d2e-92d2-a0587f1fc316 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f20746e8-1e4f-4d2e-92d2-a0587f1fc316 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f20746e8-1e4f-4d2e-92d2-a0587f1fc316 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f20746e8-1e4f-4d2e-92d2-a0587f1fc316 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f20746e8-1e4f-4d2e-92d2-a0587f1fc316 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:54 devstack sudo[113016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:39:54 devstack sudo[113016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] Created reservations ['0c65021a-cefc-4991-8bc7-b615b241513d', '8230c977-386b-4abc-9776-5a6622f11493', '77c3f3fd-3e37-48c3-afee-fad978fa5ee3', 'c168e5a4-732c-4244-8a10-96450e44ffac'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:54 devstack sudo[113018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:39:54 devstack sudo[113018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3e572ea1-cebb-4eb3-b276-805b04065ebf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "cinder-e7068eed-595b-4a80-91cf-ea7e7bb97347-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3e572ea1-cebb-4eb3-b276-805b04065ebf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-e7068eed-595b-4a80-91cf-ea7e7bb97347-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3e572ea1-cebb-4eb3-b276-805b04065ebf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "cinder-quobyte-e7068eed-595b-4a80-91cf-ea7e7bb97347" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:54 devstack sudo[113016]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f20746e8-1e4f-4d2e-92d2-a0587f1fc316 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.646s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-f20746e8-1e4f-4d2e-92d2-a0587f1fc316 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3e572ea1-cebb-4eb3-b276-805b04065ebf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-quobyte-e7068eed-595b-4a80-91cf-ea7e7bb97347" acquired by "delete_volume" :: waited 0.021s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:54 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f20746e8-1e4f-4d2e-92d2-a0587f1fc316 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Deleted volume successfully. Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[733d60a8-6935-4ebc-90e9-0a6146b3fe2f]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3e572ea1-cebb-4eb3-b276-805b04065ebf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e7068eed-595b-4a80-91cf-ea7e7bb97347 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f20746e8-1e4f-4d2e-92d2-a0587f1fc316 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-d470931f-071a-42c7-9ffe-2539457f9e88-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:54 devstack sudo[113018]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.632s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:39:54 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] Deleted volume successfully. Apr 29 17:39:54 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-f3f789cb-46f8-428d-9b4c-d7b4744a5309 tempest-VolumeImageDependencyTests-1462280589 None] Lock "cinder-47537593-095f-49d3-aba0-a1a251d6a83c-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:54 devstack sudo[113022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e7068eed-595b-4a80-91cf-ea7e7bb97347 Apr 29 17:39:54 devstack sudo[113022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:55 devstack sudo[113022]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3e572ea1-cebb-4eb3-b276-805b04065ebf tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e7068eed-595b-4a80-91cf-ea7e7bb97347" returned: 0 in 0.714s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:55 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3e572ea1-cebb-4eb3-b276-805b04065ebf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e7068eed-595b-4a80-91cf-ea7e7bb97347 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:55 devstack sudo[113027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e7068eed-595b-4a80-91cf-ea7e7bb97347 Apr 29 17:39:55 devstack sudo[113027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:56 devstack sudo[113027]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3e572ea1-cebb-4eb3-b276-805b04065ebf tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-e7068eed-595b-4a80-91cf-ea7e7bb97347" returned: 0 in 0.663s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3e572ea1-cebb-4eb3-b276-805b04065ebf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-quobyte-e7068eed-595b-4a80-91cf-ea7e7bb97347" released by "delete_volume" :: held 1.423s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:56 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-3e572ea1-cebb-4eb3-b276-805b04065ebf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Created reservations ['d8cb8209-d11e-4747-be13-c23118f3d1f6', 'a9a26877-cdfe-4874-95e9-2849f014d246', '801e6d26-28e9-4f47-81e7-05e4f079d473', 'ab97bd25-4291-4365-8c62-b102b56cf7c9'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:39:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3e572ea1-cebb-4eb3-b276-805b04065ebf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3e572ea1-cebb-4eb3-b276-805b04065ebf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3e572ea1-cebb-4eb3-b276-805b04065ebf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:56 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-3e572ea1-cebb-4eb3-b276-805b04065ebf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-3e572ea1-cebb-4eb3-b276-805b04065ebf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3e572ea1-cebb-4eb3-b276-805b04065ebf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:56 devstack sudo[113030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:39:56 devstack sudo[113030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-601f03b7-0c21-4973-b219-13bae5adf8cf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "cinder-ec24336d-5f3e-4004-bc28-46135b3780ff-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-601f03b7-0c21-4973-b219-13bae5adf8cf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-ec24336d-5f3e-4004-bc28-46135b3780ff-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:56 devstack sudo[113030]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3e572ea1-cebb-4eb3-b276-805b04065ebf tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.635s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:56 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-3e572ea1-cebb-4eb3-b276-805b04065ebf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:39:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-601f03b7-0c21-4973-b219-13bae5adf8cf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "cinder-quobyte-ec24336d-5f3e-4004-bc28-46135b3780ff" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:56 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-3e572ea1-cebb-4eb3-b276-805b04065ebf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Deleted volume successfully. Apr 29 17:39:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-601f03b7-0c21-4973-b219-13bae5adf8cf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-quobyte-ec24336d-5f3e-4004-bc28-46135b3780ff" acquired by "delete_volume" :: waited 0.025s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:56 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3e572ea1-cebb-4eb3-b276-805b04065ebf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-e7068eed-595b-4a80-91cf-ea7e7bb97347-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:56 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[8661b95c-b2f4-4076-b5f6-e33f154c3143]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:56 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-601f03b7-0c21-4973-b219-13bae5adf8cf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ec24336d-5f3e-4004-bc28-46135b3780ff {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:57 devstack sudo[113034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ec24336d-5f3e-4004-bc28-46135b3780ff Apr 29 17:39:57 devstack sudo[113034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:57 devstack sudo[113034]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-601f03b7-0c21-4973-b219-13bae5adf8cf tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ec24336d-5f3e-4004-bc28-46135b3780ff" returned: 0 in 0.720s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:57 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-601f03b7-0c21-4973-b219-13bae5adf8cf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ec24336d-5f3e-4004-bc28-46135b3780ff {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:57 devstack sudo[113040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ec24336d-5f3e-4004-bc28-46135b3780ff Apr 29 17:39:57 devstack sudo[113040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:58 devstack sudo[113040]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-601f03b7-0c21-4973-b219-13bae5adf8cf tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-ec24336d-5f3e-4004-bc28-46135b3780ff" returned: 0 in 0.591s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:58 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-601f03b7-0c21-4973-b219-13bae5adf8cf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-quobyte-ec24336d-5f3e-4004-bc28-46135b3780ff" released by "delete_volume" :: held 1.351s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:58 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-601f03b7-0c21-4973-b219-13bae5adf8cf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Created reservations ['fd7d6607-159b-4033-8658-824c88c956d6', '5cd9b949-a3bd-4a60-94a4-adeb04297d50', 'fd99acad-98cf-48e4-8a39-60d00433be05', '780fce19-4d0e-46ac-9adb-3f7f9f32ab9e'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:39:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-601f03b7-0c21-4973-b219-13bae5adf8cf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:39:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-601f03b7-0c21-4973-b219-13bae5adf8cf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:39:58 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-601f03b7-0c21-4973-b219-13bae5adf8cf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:39:58 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-601f03b7-0c21-4973-b219-13bae5adf8cf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:39:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-601f03b7-0c21-4973-b219-13bae5adf8cf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:39:58 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-601f03b7-0c21-4973-b219-13bae5adf8cf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:58 devstack sudo[113043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:39:58 devstack sudo[113043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:59 devstack sudo[113043]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-601f03b7-0c21-4973-b219-13bae5adf8cf tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.585s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:59 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-601f03b7-0c21-4973-b219-13bae5adf8cf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:39:59 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-601f03b7-0c21-4973-b219-13bae5adf8cf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Deleted volume successfully. Apr 29 17:39:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-601f03b7-0c21-4973-b219-13bae5adf8cf tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-ec24336d-5f3e-4004-bc28-46135b3780ff-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:39:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-889a8b2f-8670-478e-9b05-3a8ecc7f31f2 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "cinder-2cc93f05-378e-452d-8699-b7ef11086e88-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-889a8b2f-8670-478e-9b05-3a8ecc7f31f2 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-2cc93f05-378e-452d-8699-b7ef11086e88-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-889a8b2f-8670-478e-9b05-3a8ecc7f31f2 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "cinder-quobyte-2cc93f05-378e-452d-8699-b7ef11086e88" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:39:59 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-889a8b2f-8670-478e-9b05-3a8ecc7f31f2 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-quobyte-2cc93f05-378e-452d-8699-b7ef11086e88" acquired by "delete_volume" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:39:59 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8cc672-2aad-400c-b332-931ea0d0b127]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:39:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-889a8b2f-8670-478e-9b05-3a8ecc7f31f2 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2cc93f05-378e-452d-8699-b7ef11086e88 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:59 devstack sudo[113048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2cc93f05-378e-452d-8699-b7ef11086e88 Apr 29 17:39:59 devstack sudo[113048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:39:59 devstack sudo[113048]: pam_unix(sudo:session): session closed for user root Apr 29 17:39:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-889a8b2f-8670-478e-9b05-3a8ecc7f31f2 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2cc93f05-378e-452d-8699-b7ef11086e88" returned: 0 in 0.698s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:39:59 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-889a8b2f-8670-478e-9b05-3a8ecc7f31f2 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2cc93f05-378e-452d-8699-b7ef11086e88 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:39:59 devstack sudo[113053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2cc93f05-378e-452d-8699-b7ef11086e88 Apr 29 17:39:59 devstack sudo[113053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:00 devstack sudo[113053]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-889a8b2f-8670-478e-9b05-3a8ecc7f31f2 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-2cc93f05-378e-452d-8699-b7ef11086e88" returned: 0 in 0.576s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:00 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-889a8b2f-8670-478e-9b05-3a8ecc7f31f2 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-quobyte-2cc93f05-378e-452d-8699-b7ef11086e88" released by "delete_volume" :: held 1.314s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:40:00 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-889a8b2f-8670-478e-9b05-3a8ecc7f31f2 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Created reservations ['0955b7b1-4bb5-4a5a-a841-6830a0304edc', '95dcb604-7105-449c-a74f-1693221fd194', 'fa16dc42-d3c4-46ac-a000-6ea1eb753d50', '11066fe0-97e2-4d8e-9af8-f4925c22dafb'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:40:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-889a8b2f-8670-478e-9b05-3a8ecc7f31f2 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:40:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-889a8b2f-8670-478e-9b05-3a8ecc7f31f2 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:40:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-889a8b2f-8670-478e-9b05-3a8ecc7f31f2 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:40:00 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-889a8b2f-8670-478e-9b05-3a8ecc7f31f2 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:40:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-889a8b2f-8670-478e-9b05-3a8ecc7f31f2 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:40:00 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-889a8b2f-8670-478e-9b05-3a8ecc7f31f2 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:00 devstack sudo[113056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:40:00 devstack sudo[113056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:01 devstack sudo[113056]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-889a8b2f-8670-478e-9b05-3a8ecc7f31f2 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.593s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:01 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-889a8b2f-8670-478e-9b05-3a8ecc7f31f2 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:40:01 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-889a8b2f-8670-478e-9b05-3a8ecc7f31f2 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Deleted volume successfully. Apr 29 17:40:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-889a8b2f-8670-478e-9b05-3a8ecc7f31f2 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-2cc93f05-378e-452d-8699-b7ef11086e88-delete_volume" released by "delete_volume" :: held 2.087s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:40:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2f7f5e62-7bda-4b31-a188-8e97b67c8e13 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "cinder-20622c02-407d-4d79-bf46-84665e239665-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:40:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2f7f5e62-7bda-4b31-a188-8e97b67c8e13 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-20622c02-407d-4d79-bf46-84665e239665-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:40:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2f7f5e62-7bda-4b31-a188-8e97b67c8e13 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "cinder-quobyte-20622c02-407d-4d79-bf46-84665e239665" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:40:01 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2f7f5e62-7bda-4b31-a188-8e97b67c8e13 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-quobyte-20622c02-407d-4d79-bf46-84665e239665" acquired by "delete_volume" :: waited 0.018s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:40:01 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[14612e5d-8f81-4ae4-8a52-f1cb66702dd2]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:40:01 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2f7f5e62-7bda-4b31-a188-8e97b67c8e13 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-20622c02-407d-4d79-bf46-84665e239665 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:01 devstack sudo[113059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-20622c02-407d-4d79-bf46-84665e239665 Apr 29 17:40:01 devstack sudo[113059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:02 devstack sudo[113059]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2f7f5e62-7bda-4b31-a188-8e97b67c8e13 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-20622c02-407d-4d79-bf46-84665e239665" returned: 0 in 0.709s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2f7f5e62-7bda-4b31-a188-8e97b67c8e13 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-20622c02-407d-4d79-bf46-84665e239665 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:02 devstack sudo[113064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-20622c02-407d-4d79-bf46-84665e239665 Apr 29 17:40:02 devstack sudo[113064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:02 devstack sudo[113064]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2f7f5e62-7bda-4b31-a188-8e97b67c8e13 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-20622c02-407d-4d79-bf46-84665e239665" returned: 0 in 0.591s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:02 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2f7f5e62-7bda-4b31-a188-8e97b67c8e13 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-quobyte-20622c02-407d-4d79-bf46-84665e239665" released by "delete_volume" :: held 1.347s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:40:02 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-2f7f5e62-7bda-4b31-a188-8e97b67c8e13 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Created reservations ['e64b8c76-985b-4476-8066-a9218ee22bc8', 'b01d0b6a-a9e2-4f06-b881-c516a1c985c2', '7c1595fa-3445-4a5b-a39e-d3fc548eac42', '5ff654fb-3a2a-4eb2-8035-57f4d012190d'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:40:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2f7f5e62-7bda-4b31-a188-8e97b67c8e13 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:40:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2f7f5e62-7bda-4b31-a188-8e97b67c8e13 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:40:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-2f7f5e62-7bda-4b31-a188-8e97b67c8e13 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:40:02 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-2f7f5e62-7bda-4b31-a188-8e97b67c8e13 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:40:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-2f7f5e62-7bda-4b31-a188-8e97b67c8e13 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:40:02 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2f7f5e62-7bda-4b31-a188-8e97b67c8e13 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:02 devstack sudo[113067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:40:02 devstack sudo[113067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:03 devstack sudo[113067]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-2f7f5e62-7bda-4b31-a188-8e97b67c8e13 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.585s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:03 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-2f7f5e62-7bda-4b31-a188-8e97b67c8e13 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:40:03 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-2f7f5e62-7bda-4b31-a188-8e97b67c8e13 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Deleted volume successfully. Apr 29 17:40:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-2f7f5e62-7bda-4b31-a188-8e97b67c8e13 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-20622c02-407d-4d79-bf46-84665e239665-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:40:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "cinder-04fc64d2-4ab1-492d-aa30-397f29e1958b-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:40:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-04fc64d2-4ab1-492d-aa30-397f29e1958b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:40:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "cinder-quobyte-5984b101-9c7e-4183-8df5-4b36e4df75e4" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:40:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-quobyte-5984b101-9c7e-4183-8df5-4b36e4df75e4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:40:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "cinder-quobyte-04fc64d2-4ab1-492d-aa30-397f29e1958b" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:40:03 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-quobyte-04fc64d2-4ab1-492d-aa30-397f29e1958b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:40:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] Deleting offline snapshot 04fc64d2-4ab1-492d-aa30-397f29e1958b of volume 5984b101-9c7e-4183-8df5-4b36e4df75e4 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:40:03 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] snapshot_file for this snap is: volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.04fc64d2-4ab1-492d-aa30-397f29e1958b {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:40:03 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[41daee81-18e9-4019-bac9-0976b1888aef]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:40:03 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.04fc64d2-4ab1-492d-aa30-397f29e1958b {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:03 devstack sudo[113070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.04fc64d2-4ab1-492d-aa30-397f29e1958b Apr 29 17:40:03 devstack sudo[113070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:04 devstack sudo[113070]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.04fc64d2-4ab1-492d-aa30-397f29e1958b" returned: 0 in 0.721s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:04 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5984b101-9c7e-4183-8df5-4b36e4df75e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:40:04 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[5850c1a8-e917-447d-9345-14468ac22bd7]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:40:04 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:04 devstack sudo[113075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4 Apr 29 17:40:04 devstack sudo[113075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:05 devstack sudo[113075]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4" returned: 0 in 0.718s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.04fc64d2-4ab1-492d-aa30-397f29e1958b {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:05 devstack sudo[113080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.04fc64d2-4ab1-492d-aa30-397f29e1958b Apr 29 17:40:05 devstack sudo[113080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:05 devstack cinder-volume[84547]: DEBUG oslo_service.periodic_task [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84547) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 17:40:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:40:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:40:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:40:05 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:40:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:40:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:05 devstack sudo[113085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:40:05 devstack sudo[113085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:05 devstack sudo[113080]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.04fc64d2-4ab1-492d-aa30-397f29e1958b" returned: 0 in 0.685s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:05 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.04fc64d2-4ab1-492d-aa30-397f29e1958b {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:05 devstack sudo[113088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.04fc64d2-4ab1-492d-aa30-397f29e1958b Apr 29 17:40:05 devstack sudo[113088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:06 devstack sudo[113085]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.625s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:06 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-7452253e-3a86-4986-a13c-c32d3005bf4e None None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:40:06 devstack sudo[113088]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4.04fc64d2-4ab1-492d-aa30-397f29e1958b" returned: 0 in 0.627s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-quobyte-04fc64d2-4ab1-492d-aa30-397f29e1958b" released by "_delete_snapshot" :: held 2.855s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:40:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-quobyte-5984b101-9c7e-4183-8df5-4b36e4df75e4" released by "delete_snapshot" :: held 2.875s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:40:06 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] Created reservations ['6a13d139-e89b-4b19-939f-c22c31fda285', 'd13eb511-4477-4c5a-9086-8f7e3f5bc555', 'fe519a07-0b38-4407-8284-a5b7ff37e8d6', '037c5f03-fd0c-4085-8e35-ac9e23f3c608'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:40:06 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] Delete snapshot completed successfully. Apr 29 17:40:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-81232f5c-9a1e-46a7-b436-5561fac3af5e tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-04fc64d2-4ab1-492d-aa30-397f29e1958b-delete_snapshot" released by "delete_snapshot" :: held 3.000s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:40:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-024cdbae-0b0c-426e-a322-73a82664f374 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "cinder-5984b101-9c7e-4183-8df5-4b36e4df75e4-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:40:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-024cdbae-0b0c-426e-a322-73a82664f374 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-5984b101-9c7e-4183-8df5-4b36e4df75e4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:40:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-024cdbae-0b0c-426e-a322-73a82664f374 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "cinder-quobyte-5984b101-9c7e-4183-8df5-4b36e4df75e4" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:40:06 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-024cdbae-0b0c-426e-a322-73a82664f374 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-quobyte-5984b101-9c7e-4183-8df5-4b36e4df75e4" acquired by "delete_volume" :: waited 0.015s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:40:06 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[43012d11-311d-408f-9e57-56955ffb4227]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:40:06 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-024cdbae-0b0c-426e-a322-73a82664f374 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:06 devstack sudo[113092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4 Apr 29 17:40:06 devstack sudo[113092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:07 devstack sudo[113092]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-024cdbae-0b0c-426e-a322-73a82664f374 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4" returned: 0 in 0.696s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:07 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-024cdbae-0b0c-426e-a322-73a82664f374 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:07 devstack sudo[113098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4 Apr 29 17:40:07 devstack sudo[113098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:08 devstack sudo[113098]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-024cdbae-0b0c-426e-a322-73a82664f374 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-5984b101-9c7e-4183-8df5-4b36e4df75e4" returned: 0 in 0.619s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:08 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-024cdbae-0b0c-426e-a322-73a82664f374 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-quobyte-5984b101-9c7e-4183-8df5-4b36e4df75e4" released by "delete_volume" :: held 1.375s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:40:08 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-024cdbae-0b0c-426e-a322-73a82664f374 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Created reservations ['22e42b50-1f80-444e-bc8f-d4bca5fb0159', '6ad5c983-b2a6-4714-833f-683fef0946fb', '57f99341-2da2-4cf2-95b4-b7bd1f138b5b', '936abf70-1859-4a28-a3b6-6e8a4535f61c'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:40:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-024cdbae-0b0c-426e-a322-73a82664f374 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:40:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-024cdbae-0b0c-426e-a322-73a82664f374 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:40:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-024cdbae-0b0c-426e-a322-73a82664f374 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:40:08 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-024cdbae-0b0c-426e-a322-73a82664f374 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:40:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-024cdbae-0b0c-426e-a322-73a82664f374 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:40:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-024cdbae-0b0c-426e-a322-73a82664f374 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:08 devstack sudo[113140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:40:08 devstack sudo[113140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:08 devstack sudo[113140]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:08 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-024cdbae-0b0c-426e-a322-73a82664f374 tempest-CreateVolumesFromSnapshotTest-1874363764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.639s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:08 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-024cdbae-0b0c-426e-a322-73a82664f374 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:40:08 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-024cdbae-0b0c-426e-a322-73a82664f374 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Deleted volume successfully. Apr 29 17:40:08 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-024cdbae-0b0c-426e-a322-73a82664f374 tempest-CreateVolumesFromSnapshotTest-1874363764 None] Lock "cinder-5984b101-9c7e-4183-8df5-4b36e4df75e4-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Flow 'volume_create_manager' (a9aa9a6f-2010-441d-8439-f1f27119deba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ecf5956-f32c-4e02-b7eb-f065fa31c94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ecf5956-f32c-4e02-b7eb-f065fa31c94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c44728-cea6-4145-94c0-efd469588475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b9017332c048879c829e2a818e90a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:40:11Z,use_quota=True,user_id='dc4975fd8b0141eb940ac991dd3b0717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d039cb6f-7981-4e5f-86d7-fb41dfa1dfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d039cb6f-7981-4e5f-86d7-fb41dfa1dfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f331e86-e441-4ef0-bc9a-ebaf4a660700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f331e86-e441-4ef0-bc9a-ebaf4a660700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48c44728-cea6-4145-94c0-efd469588475', 'volume_name': 'volume-48c44728-cea6-4145-94c0-efd469588475', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c2ee64-2e7d-47e2-99d4-596dbf36c190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c2ee64-2e7d-47e2-99d4-596dbf36c190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db37b9e0-7bbc-49bc-9a5b-3679188ff5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:40:11 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Volume 48c44728-cea6-4145-94c0-efd469588475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48c44728-cea6-4145-94c0-efd469588475', 'volume_size': 1} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48c44728-cea6-4145-94c0-efd469588475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b9017332c048879c829e2a818e90a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:40:11Z,use_quota=True,user_id='dc4975fd8b0141eb940ac991dd3b0717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Creating volume 48c44728-cea6-4145-94c0-efd469588475 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:40:11 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:40:11 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-48c44728-cea6-4145-94c0-efd469588475 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:11 devstack sudo[113149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-48c44728-cea6-4145-94c0-efd469588475 1073741824 Apr 29 17:40:11 devstack sudo[113149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:12 devstack sudo[113149]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-48c44728-cea6-4145-94c0-efd469588475 1073741824" returned: 0 in 0.804s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:12 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-48c44728-cea6-4145-94c0-efd469588475 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:12 devstack sudo[113155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-48c44728-cea6-4145-94c0-efd469588475 Apr 29 17:40:12 devstack sudo[113155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:13 devstack sudo[113155]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-48c44728-cea6-4145-94c0-efd469588475" returned: 0 in 0.650s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:13 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:40:13 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:40:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db37b9e0-7bbc-49bc-9a5b-3679188ff5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48c44728-cea6-4145-94c0-efd469588475', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:40:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdda68c4-3264-4475-801a-c4e64a6c28f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:40:13 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Volume volume-48c44728-cea6-4145-94c0-efd469588475 (48c44728-cea6-4145-94c0-efd469588475): created successfully Apr 29 17:40:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdda68c4-3264-4475-801a-c4e64a6c28f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:40:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Flow 'volume_create_manager' (a9aa9a6f-2010-441d-8439-f1f27119deba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:40:13 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-ab2f2fd2-14f8-4f3b-a387-5b48b7072fb3 tempest-CinderUnicodeTest-2009838935 None] Created volume successfully. Apr 29 17:40:13 devstack cinder-volume[84547]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84547) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 29 17:40:13 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Flow 'volume_create_manager' (0f0f477e-32ff-4fed-b6ea-9771b6360a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d43b719-361c-4890-b882-534218f21663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d43b719-361c-4890-b882-534218f21663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:40:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2143399444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4081c5-293d-43a5-bf7a-ffa416e0b152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b9017332c048879c829e2a818e90a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:40:14Z,use_quota=True,user_id='dc4975fd8b0141eb940ac991dd3b0717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a63ad2-21d4-4d66-8f76-3b0e30732524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a63ad2-21d4-4d66-8f76-3b0e30732524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c479cbc-1f6b-40dd-a9e2-2f4161d5b108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c479cbc-1f6b-40dd-a9e2-2f4161d5b108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb4081c5-293d-43a5-bf7a-ffa416e0b152', 'volume_name': 'volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2de32c6-a3e9-44da-997a-f2d034825483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2de32c6-a3e9-44da-997a-f2d034825483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c59d45-3c71-4299-b6c6-c483a5dd33dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:40:14 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Volume cb4081c5-293d-43a5-bf7a-ffa416e0b152: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152', 'volume_size': 1} Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T15:40:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2143399444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4081c5-293d-43a5-bf7a-ffa416e0b152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b9017332c048879c829e2a818e90a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T15:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T15:40:14Z,use_quota=True,user_id='dc4975fd8b0141eb940ac991dd3b0717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a451dfb0-15f9-43db-9049-e6389770f5c5),volume_type_id=a451dfb0-15f9-43db-9049-e6389770f5c5)}" {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Creating volume cb4081c5-293d-43a5-bf7a-ffa416e0b152 {{(pid=84547) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Selected osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 as target Quobyte volume. {{(pid=84547) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 17:40:14 devstack cinder-volume[84547]: INFO cinder.volume.drivers.remotefs [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] casted to osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6 Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152 1073741824 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:14 devstack sudo[113159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152 1073741824 Apr 29 17:40:14 devstack sudo[113159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:14 devstack sudo[113159]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152 1073741824" returned: 0 in 0.781s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:14 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:14 devstack sudo[113165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152 Apr 29 17:40:14 devstack sudo[113165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:15 devstack sudo[113165]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152" returned: 0 in 0.625s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:15 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'} {{(pid=84547) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 17:40:15 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:40:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c59d45-3c71-4299-b6c6-c483a5dd33dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152', 'volume_size': 1}' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:40:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71009c56-16ea-42a6-855e-4169b06a94f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 17:40:15 devstack cinder-volume[84547]: INFO cinder.volume.flows.manager.create_volume [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Volume volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152 (cb4081c5-293d-43a5-bf7a-ffa416e0b152): created successfully Apr 29 17:40:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71009c56-16ea-42a6-855e-4169b06a94f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84547) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 17:40:15 devstack cinder-volume[84547]: DEBUG cinder.volume.manager [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Flow 'volume_create_manager' (0f0f477e-32ff-4fed-b6ea-9771b6360a70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84547) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 17:40:15 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-bac672f1-e523-495c-8beb-9bcc7a9280fe tempest-CinderUnicodeTest-2009838935 None] Created volume successfully. Apr 29 17:40:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8ef82652-f521-445c-b04b-affba48429d3 tempest-CinderUnicodeTest-2009838935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:40:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8ef82652-f521-445c-b04b-affba48429d3 tempest-CinderUnicodeTest-2009838935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:40:16 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-8ef82652-f521-445c-b04b-affba48429d3 tempest-CinderUnicodeTest-2009838935 None] Creating offline snapshot d72ec470-3a3c-401c-9548-9207915f5691 of volume cb4081c5-293d-43a5-bf7a-ffa416e0b152 {{(pid=84547) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 29 17:40:16 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a81fc2f-a52b-4e2b-be6b-8d5251fb1f85]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:40:16 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ef82652-f521-445c-b04b-affba48429d3 tempest-CinderUnicodeTest-2009838935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:16 devstack sudo[113168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152 Apr 29 17:40:16 devstack sudo[113168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:17 devstack sudo[113168]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ef82652-f521-445c-b04b-affba48429d3 tempest-CinderUnicodeTest-2009838935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152" returned: 0 in 0.739s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ef82652-f521-445c-b04b-affba48429d3 tempest-CinderUnicodeTest-2009838935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.d72ec470-3a3c-401c-9548-9207915f5691 1G {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:17 devstack sudo[113173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.d72ec470-3a3c-401c-9548-9207915f5691 1G Apr 29 17:40:17 devstack sudo[113173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:17 devstack sudo[113173]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ef82652-f521-445c-b04b-affba48429d3 tempest-CinderUnicodeTest-2009838935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.d72ec470-3a3c-401c-9548-9207915f5691 1G" returned: 0 in 0.724s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:17 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ef82652-f521-445c-b04b-affba48429d3 tempest-CinderUnicodeTest-2009838935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.d72ec470-3a3c-401c-9548-9207915f5691 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:17 devstack sudo[113179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.d72ec470-3a3c-401c-9548-9207915f5691 Apr 29 17:40:17 devstack sudo[113179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:18 devstack sudo[113179]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ef82652-f521-445c-b04b-affba48429d3 tempest-CinderUnicodeTest-2009838935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152 -F qcow2 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.d72ec470-3a3c-401c-9548-9207915f5691" returned: 0 in 0.619s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:18 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-8ef82652-f521-445c-b04b-affba48429d3 tempest-CinderUnicodeTest-2009838935 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.d72ec470-3a3c-401c-9548-9207915f5691 is being set with open permissions: ugo+rw Apr 29 17:40:18 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ef82652-f521-445c-b04b-affba48429d3 tempest-CinderUnicodeTest-2009838935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.d72ec470-3a3c-401c-9548-9207915f5691 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:18 devstack sudo[113184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.d72ec470-3a3c-401c-9548-9207915f5691 Apr 29 17:40:18 devstack sudo[113184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:19 devstack sudo[113184]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ef82652-f521-445c-b04b-affba48429d3 tempest-CinderUnicodeTest-2009838935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.d72ec470-3a3c-401c-9548-9207915f5691" returned: 0 in 0.637s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ef82652-f521-445c-b04b-affba48429d3 tempest-CinderUnicodeTest-2009838935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:19 devstack sudo[113187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.info Apr 29 17:40:19 devstack sudo[113187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:19 devstack sudo[113187]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ef82652-f521-445c-b04b-affba48429d3 tempest-CinderUnicodeTest-2009838935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.info" returned: 0 in 0.632s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:19 devstack cinder-volume[84547]: WARNING cinder.volume.drivers.remotefs [None req-8ef82652-f521-445c-b04b-affba48429d3 tempest-CinderUnicodeTest-2009838935 None] /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.info is being set with open permissions: ugo+rw Apr 29 17:40:19 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ef82652-f521-445c-b04b-affba48429d3 tempest-CinderUnicodeTest-2009838935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.info {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:19 devstack sudo[113190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.info Apr 29 17:40:19 devstack sudo[113190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:20 devstack sudo[113190]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-8ef82652-f521-445c-b04b-affba48429d3 tempest-CinderUnicodeTest-2009838935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.info" returned: 0 in 0.615s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-8ef82652-f521-445c-b04b-affba48429d3 tempest-CinderUnicodeTest-2009838935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.054s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:40:20 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:DELETE=14,cinder:SELECT=107,cinder:INSERT=50,cinder:UPDATE=153 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:40:20 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-8ef82652-f521-445c-b04b-affba48429d3 tempest-CinderUnicodeTest-2009838935 None] Create snapshot completed successfully Apr 29 17:40:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] Acquiring lock "cinder-d72ec470-3a3c-401c-9548-9207915f5691-delete_snapshot" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:40:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] Lock "cinder-d72ec470-3a3c-401c-9548-9207915f5691-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:40:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] Acquiring lock "cinder-quobyte-cb4081c5-293d-43a5-bf7a-ffa416e0b152" by "delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:40:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] Lock "cinder-quobyte-cb4081c5-293d-43a5-bf7a-ffa416e0b152" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:40:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] Acquiring lock "cinder-quobyte-d72ec470-3a3c-401c-9548-9207915f5691" by "_delete_snapshot" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:40:20 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] Lock "cinder-quobyte-d72ec470-3a3c-401c-9548-9207915f5691" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:40:20 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] Deleting offline snapshot d72ec470-3a3c-401c-9548-9207915f5691 of volume cb4081c5-293d-43a5-bf7a-ffa416e0b152 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 17:40:20 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] snapshot_file for this snap is: volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.d72ec470-3a3c-401c-9548-9207915f5691 {{(pid=84547) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 17:40:20 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0a2e7c-3a2b-4002-bb19-2db49e87f727]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:40:20 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.d72ec470-3a3c-401c-9548-9207915f5691 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:20 devstack sudo[113193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.d72ec470-3a3c-401c-9548-9207915f5691 Apr 29 17:40:20 devstack sudo[113193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:21 devstack sudo[113193]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.d72ec470-3a3c-401c-9548-9207915f5691" returned: 0 in 0.706s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:21 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.remotefs [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84547) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 17:40:21 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fcce4d-4b1b-47a8-a503-9aa3df8a1315]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:40:21 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:21 devstack sudo[113198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152 Apr 29 17:40:21 devstack sudo[113198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:22 devstack sudo[113198]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152" returned: 0 in 0.700s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.d72ec470-3a3c-401c-9548-9207915f5691 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:22 devstack sudo[113203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.d72ec470-3a3c-401c-9548-9207915f5691 Apr 29 17:40:22 devstack sudo[113203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:22 devstack sudo[113203]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.d72ec470-3a3c-401c-9548-9207915f5691" returned: 0 in 0.693s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:22 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.d72ec470-3a3c-401c-9548-9207915f5691 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:22 devstack sudo[113208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.d72ec470-3a3c-401c-9548-9207915f5691 Apr 29 17:40:22 devstack sudo[113208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:23 devstack sudo[113208]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152.d72ec470-3a3c-401c-9548-9207915f5691" returned: 0 in 0.596s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:23 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:UPDATE=157,cinder:DELETE=12,cinder:SELECT=115,cinder:INSERT=35 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:40:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] Lock "cinder-quobyte-d72ec470-3a3c-401c-9548-9207915f5691" released by "_delete_snapshot" :: held 2.798s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:40:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] Lock "cinder-quobyte-cb4081c5-293d-43a5-bf7a-ffa416e0b152" released by "delete_snapshot" :: held 2.821s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:40:23 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] Created reservations ['26ede15a-c433-4be2-b547-1b18661323d0', 'e746496c-1709-48de-9462-c6e807ad18af', '85eccaab-db03-41d2-8359-b1819fcfa859', '304bd9f3-1cfe-4c1e-b1e4-ab4d01ca07d5'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:40:23 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] Delete snapshot completed successfully. Apr 29 17:40:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-3882b334-def1-4b2a-b1d4-779b4471c128 tempest-CinderUnicodeTest-2009838935 None] Lock "cinder-d72ec470-3a3c-401c-9548-9207915f5691-delete_snapshot" released by "delete_snapshot" :: held 2.964s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:40:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-74c88e89-4d92-4cea-b09b-8c2e8d87b727 tempest-CinderUnicodeTest-2009838935 None] Acquiring lock "cinder-cb4081c5-293d-43a5-bf7a-ffa416e0b152-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:40:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-74c88e89-4d92-4cea-b09b-8c2e8d87b727 tempest-CinderUnicodeTest-2009838935 None] Lock "cinder-cb4081c5-293d-43a5-bf7a-ffa416e0b152-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:40:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-74c88e89-4d92-4cea-b09b-8c2e8d87b727 tempest-CinderUnicodeTest-2009838935 None] Acquiring lock "cinder-quobyte-cb4081c5-293d-43a5-bf7a-ffa416e0b152" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:40:23 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-74c88e89-4d92-4cea-b09b-8c2e8d87b727 tempest-CinderUnicodeTest-2009838935 None] Lock "cinder-quobyte-cb4081c5-293d-43a5-bf7a-ffa416e0b152" acquired by "delete_volume" :: waited 0.022s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:40:23 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d41ed45-c222-49b9-8d04-c44a659b4089]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:40:23 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-74c88e89-4d92-4cea-b09b-8c2e8d87b727 tempest-CinderUnicodeTest-2009838935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:23 devstack sudo[113211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152 Apr 29 17:40:23 devstack sudo[113211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:24 devstack sudo[113211]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-74c88e89-4d92-4cea-b09b-8c2e8d87b727 tempest-CinderUnicodeTest-2009838935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152" returned: 0 in 0.743s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:24 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-74c88e89-4d92-4cea-b09b-8c2e8d87b727 tempest-CinderUnicodeTest-2009838935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:24 devstack sudo[113216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152 Apr 29 17:40:24 devstack sudo[113216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:25 devstack sudo[113216]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-74c88e89-4d92-4cea-b09b-8c2e8d87b727 tempest-CinderUnicodeTest-2009838935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-cb4081c5-293d-43a5-bf7a-ffa416e0b152" returned: 0 in 0.637s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-74c88e89-4d92-4cea-b09b-8c2e8d87b727 tempest-CinderUnicodeTest-2009838935 None] Lock "cinder-quobyte-cb4081c5-293d-43a5-bf7a-ffa416e0b152" released by "delete_volume" :: held 1.436s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:40:25 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-74c88e89-4d92-4cea-b09b-8c2e8d87b727 tempest-CinderUnicodeTest-2009838935 None] Created reservations ['8ff867b1-9a67-4136-8825-1cb605779670', '783cc2d3-f745-4617-8c7a-f6b769ab36d3', 'e8583cdc-2cd1-4a43-9f25-3f091581c938', '63c1f40c-d940-4d2b-89ab-585a24ee7bd8'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:40:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-74c88e89-4d92-4cea-b09b-8c2e8d87b727 tempest-CinderUnicodeTest-2009838935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:40:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-74c88e89-4d92-4cea-b09b-8c2e8d87b727 tempest-CinderUnicodeTest-2009838935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:40:25 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-74c88e89-4d92-4cea-b09b-8c2e8d87b727 tempest-CinderUnicodeTest-2009838935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:40:25 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-74c88e89-4d92-4cea-b09b-8c2e8d87b727 tempest-CinderUnicodeTest-2009838935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:40:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-74c88e89-4d92-4cea-b09b-8c2e8d87b727 tempest-CinderUnicodeTest-2009838935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:40:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-74c88e89-4d92-4cea-b09b-8c2e8d87b727 tempest-CinderUnicodeTest-2009838935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:25 devstack sudo[113219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:40:25 devstack sudo[113219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d39c5491-a7ee-4f9d-b01a-7466c9d8113d tempest-CinderUnicodeTest-2009838935 None] Acquiring lock "cinder-48c44728-cea6-4145-94c0-efd469588475-delete_volume" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:40:25 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d39c5491-a7ee-4f9d-b01a-7466c9d8113d tempest-CinderUnicodeTest-2009838935 None] Lock "cinder-48c44728-cea6-4145-94c0-efd469588475-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:40:25 devstack sudo[113219]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:25 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-74c88e89-4d92-4cea-b09b-8c2e8d87b727 tempest-CinderUnicodeTest-2009838935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.630s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:25 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-74c88e89-4d92-4cea-b09b-8c2e8d87b727 tempest-CinderUnicodeTest-2009838935 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:40:25 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-74c88e89-4d92-4cea-b09b-8c2e8d87b727 tempest-CinderUnicodeTest-2009838935 None] Deleted volume successfully. Apr 29 17:40:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d39c5491-a7ee-4f9d-b01a-7466c9d8113d tempest-CinderUnicodeTest-2009838935 None] Acquiring lock "cinder-quobyte-48c44728-cea6-4145-94c0-efd469588475" by "delete_volume" {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 17:40:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-74c88e89-4d92-4cea-b09b-8c2e8d87b727 tempest-CinderUnicodeTest-2009838935 None] Lock "cinder-cb4081c5-293d-43a5-bf7a-ffa416e0b152-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:40:26 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d39c5491-a7ee-4f9d-b01a-7466c9d8113d tempest-CinderUnicodeTest-2009838935 None] Lock "cinder-quobyte-48c44728-cea6-4145-94c0-efd469588475" acquired by "delete_volume" :: waited 0.017s {{(pid=84547) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 17:40:26 devstack cinder-volume[84547]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ac86a0-ee89-4a9d-8f54-309ebf8f2d3b]: (4, 'qcow2') {{(pid=85470) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 17:40:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d39c5491-a7ee-4f9d-b01a-7466c9d8113d tempest-CinderUnicodeTest-2009838935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-48c44728-cea6-4145-94c0-efd469588475 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:26 devstack sudo[113222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-48c44728-cea6-4145-94c0-efd469588475 Apr 29 17:40:26 devstack sudo[113222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:26 devstack sudo[113222]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d39c5491-a7ee-4f9d-b01a-7466c9d8113d tempest-CinderUnicodeTest-2009838935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-48c44728-cea6-4145-94c0-efd469588475" returned: 0 in 0.763s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:26 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d39c5491-a7ee-4f9d-b01a-7466c9d8113d tempest-CinderUnicodeTest-2009838935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-48c44728-cea6-4145-94c0-efd469588475 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:26 devstack sudo[113227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-48c44728-cea6-4145-94c0-efd469588475 Apr 29 17:40:26 devstack sudo[113227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:27 devstack sudo[113227]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d39c5491-a7ee-4f9d-b01a-7466c9d8113d tempest-CinderUnicodeTest-2009838935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685/volume-48c44728-cea6-4145-94c0-efd469588475" returned: 0 in 0.594s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:27 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d39c5491-a7ee-4f9d-b01a-7466c9d8113d tempest-CinderUnicodeTest-2009838935 None] Lock "cinder-quobyte-48c44728-cea6-4145-94c0-efd469588475" released by "delete_volume" :: held 1.395s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:40:27 devstack cinder-volume[84547]: DEBUG cinder.quota [None req-d39c5491-a7ee-4f9d-b01a-7466c9d8113d tempest-CinderUnicodeTest-2009838935 None] Created reservations ['9457e2e9-5a93-4004-a92e-46c81685cfa0', '61ab0755-8428-4113-a6de-9ea98ba87d57', 'abbf58bc-ca89-45b9-9a72-187687772b3a', '76e30cc0-d89b-43fc-a093-ecbd697e7bd5'] {{(pid=84547) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 17:40:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d39c5491-a7ee-4f9d-b01a-7466c9d8113d tempest-CinderUnicodeTest-2009838935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 17:40:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d39c5491-a7ee-4f9d-b01a-7466c9d8113d tempest-CinderUnicodeTest-2009838935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 17:40:27 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d39c5491-a7ee-4f9d-b01a-7466c9d8113d tempest-CinderUnicodeTest-2009838935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6': None} {{(pid=84547) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 17:40:27 devstack cinder-volume[84547]: DEBUG cinder.volume.drivers.quobyte [None req-d39c5491-a7ee-4f9d-b01a-7466c9d8113d tempest-CinderUnicodeTest-2009838935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-c1218849-f455-4b33-80fb-6d753db01de6'] {{(pid=84547) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 17:40:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.lockutils [None req-d39c5491-a7ee-4f9d-b01a-7466c9d8113d tempest-CinderUnicodeTest-2009838935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84547) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 17:40:27 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d39c5491-a7ee-4f9d-b01a-7466c9d8113d tempest-CinderUnicodeTest-2009838935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 17:40:27 devstack sudo[113231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685 Apr 29 17:40:27 devstack sudo[113231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 17:40:28 devstack sudo[113231]: pam_unix(sudo:session): session closed for user root Apr 29 17:40:28 devstack cinder-volume[84547]: DEBUG oslo_concurrency.processutils [None req-d39c5491-a7ee-4f9d-b01a-7466c9d8113d tempest-CinderUnicodeTest-2009838935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9c63f729801ae21d2d0cd4a3966b3685" returned: 0 in 0.586s {{(pid=84547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 17:40:28 devstack cinder-volume[84547]: DEBUG cinder.manager [None req-d39c5491-a7ee-4f9d-b01a-7466c9d8113d tempest-CinderUnicodeTest-2009838935 None] Notifying Schedulers of capabilities ... {{(pid=84547) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 17:40:28 devstack cinder-volume[84547]: INFO cinder.volume.manager [None req-d39c5491-a7ee-4f9d-b01a-7466c9d8113d tempest-CinderUnicodeTest-2009838935 None] Deleted volume successfully. Apr 29 17:40:28 devstack cinder-volume[84547]: DEBUG cinder.coordination [None req-d39c5491-a7ee-4f9d-b01a-7466c9d8113d tempest-CinderUnicodeTest-2009838935 None] Lock "cinder-48c44728-cea6-4145-94c0-efd469588475-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=84547) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 17:40:37 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 17:40:38 devstack cinder-volume[84547]: DEBUG dbcounter [-] [84547] Writing DB stats cinder:SELECT=17,cinder:INSERT=7,cinder:UPDATE=22,cinder:DELETE=1 {{(pid=84547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}